-- Logs begin at Wed 2022-07-27 17:49:58 UTC, end at Wed 2022-07-27 19:20:52 UTC. -- Jul 27 18:50:59.159913 dv-osbrick-849020-4-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jul 27 18:50:59.168971 dv-osbrick-849020-4-iscsi devstack@keystone.service[80062]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 27 18:50:59.171063 dv-osbrick-849020-4-iscsi devstack@keystone.service[80062]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 27 18:50:59 2022] *** Jul 27 18:50:59.171063 dv-osbrick-849020-4-iscsi devstack@keystone.service[80062]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 27 18:50:59.171063 dv-osbrick-849020-4-iscsi devstack@keystone.service[80062]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 27 18:50:59.171063 dv-osbrick-849020-4-iscsi devstack@keystone.service[80062]: nodename: dv-osbrick-849020-4-iscsi Jul 27 18:50:59.171063 dv-osbrick-849020-4-iscsi devstack@keystone.service[80062]: machine: x86_64 Jul 27 18:50:59.171063 dv-osbrick-849020-4-iscsi devstack@keystone.service[80062]: clock source: unix Jul 27 18:50:59.171063 dv-osbrick-849020-4-iscsi devstack@keystone.service[80062]: pcre jit disabled Jul 27 18:50:59.171063 dv-osbrick-849020-4-iscsi devstack@keystone.service[80062]: detected number of CPU cores: 4 Jul 27 18:50:59.171063 dv-osbrick-849020-4-iscsi devstack@keystone.service[80062]: current working directory: / Jul 27 18:50:59.171063 dv-osbrick-849020-4-iscsi devstack@keystone.service[80062]: detected binary path: /usr/bin/uwsgi-core Jul 27 18:50:59.171063 dv-osbrick-849020-4-iscsi devstack@keystone.service[80062]: your processes number limit is 47680 Jul 27 18:50:59.171843 dv-osbrick-849020-4-iscsi devstack@keystone.service[80062]: your memory page size is 4096 bytes Jul 27 18:50:59.171843 dv-osbrick-849020-4-iscsi devstack@keystone.service[80062]: detected max file descriptor number: 2048 Jul 27 18:50:59.171843 dv-osbrick-849020-4-iscsi devstack@keystone.service[80062]: lock engine: pthread robust mutexes Jul 27 18:50:59.171843 dv-osbrick-849020-4-iscsi devstack@keystone.service[80062]: thunder lock: enabled Jul 27 18:50:59.171843 dv-osbrick-849020-4-iscsi devstack@keystone.service[80062]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 27 18:50:59.171843 dv-osbrick-849020-4-iscsi devstack@keystone.service[80062]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 27 18:50:59.210851 dv-osbrick-849020-4-iscsi devstack@keystone.service[80062]: Python main interpreter initialized at 0x555a1e3b79c0 Jul 27 18:50:59.210851 dv-osbrick-849020-4-iscsi devstack@keystone.service[80062]: python threads support enabled Jul 27 18:50:59.210851 dv-osbrick-849020-4-iscsi devstack@keystone.service[80062]: your server socket listen backlog is limited to 100 connections Jul 27 18:50:59.210851 dv-osbrick-849020-4-iscsi devstack@keystone.service[80062]: your mercy for graceful operations on workers is 90 seconds Jul 27 18:50:59.211209 dv-osbrick-849020-4-iscsi devstack@keystone.service[80062]: mapped 403077 bytes (393 KB) for 2 cores Jul 27 18:50:59.211265 dv-osbrick-849020-4-iscsi devstack@keystone.service[80062]: *** Operational MODE: preforking *** Jul 27 18:50:59.211546 dv-osbrick-849020-4-iscsi devstack@keystone.service[80062]: *** uWSGI is running in multiple interpreter mode *** Jul 27 18:50:59.211546 dv-osbrick-849020-4-iscsi devstack@keystone.service[80062]: spawned uWSGI master process (pid: 80062) Jul 27 18:50:59.211782 dv-osbrick-849020-4-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jul 27 18:50:59.212320 dv-osbrick-849020-4-iscsi devstack@keystone.service[80062]: spawned uWSGI worker 1 (pid: 80075, cores: 1) Jul 27 18:50:59.212683 dv-osbrick-849020-4-iscsi devstack@keystone.service[80062]: spawned uWSGI worker 2 (pid: 80076, cores: 1) Jul 27 18:50:59.215754 dv-osbrick-849020-4-iscsi devstack@keystone.service[80062]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 27 18:51:04.677158 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 18:51:04.677158 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: from cryptography.utils import int_from_bytes Jul 27 18:51:04.677932 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 18:51:04.677932 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: from cryptography.utils import int_from_bytes Jul 27 18:51:04.678353 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 18:51:04.678353 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: from cryptography.utils import int_from_bytes Jul 27 18:51:04.678453 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 18:51:04.678453 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: from cryptography.utils import int_from_bytes Jul 27 18:51:04.727622 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 18:51:04.727945 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 18:51:04.728032 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] command line args: [] {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 18:51:04.728266 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 18:51:04.728446 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] ================================================================================ {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 18:51:04.728539 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 18:51:04.728685 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 18:51:04.728772 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] admin_token = **** {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.728840 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] command line args: [] {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 18:51:04.728986 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] config_dir = [] {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.729128 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 18:51:04.729216 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.729285 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] ================================================================================ {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 18:51:04.729344 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] config_source = [] {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.729505 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] debug = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.729591 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] admin_token = **** {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.729664 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.732022 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] config_dir = [] {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.732022 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.732141 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.732199 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] config_source = [] {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.732267 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.732340 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] debug = True {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.732400 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.732462 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.732550 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.732622 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.732622 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.732724 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] list_limit = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.732724 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] log_config_append = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.732832 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.732888 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.732950 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.733014 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] log_dir = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.733077 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] list_limit = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.733141 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] log_file = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.733204 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] log_config_append = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.733261 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.733328 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.733386 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.733442 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] log_dir = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.733442 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] log_file = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.733546 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.733603 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.733670 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.733732 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.733787 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.733787 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.733895 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.733958 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.734025 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.734025 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.734160 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.734220 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.734282 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.734350 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.734414 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.734471 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.734527 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.734587 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.734650 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.734715 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.734773 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.734833 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.734896 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.734961 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.735023 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.735092 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.735828 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.736008 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.736205 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.736447 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] publish_errors = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.736447 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.737040 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.737040 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] publish_errors = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.737454 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.737654 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.737823 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.738017 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.738243 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.738416 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.738659 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.738866 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.739032 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] standard_threads = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.739225 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.739418 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.739761 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] standard_threads = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.739935 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.740140 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.740372 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.740539 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.740732 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] use_journal = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.740941 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.741107 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] use_json = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.741240 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] use_journal = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.741411 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] use_stderr = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.741542 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] use_json = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.741703 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] use_syslog = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.741846 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] use_stderr = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.741976 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.742111 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] use_syslog = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.742241 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.742415 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:51:04.742594 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.742735 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.742876 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.743008 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.743142 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.743272 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.743411 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.743546 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.743697 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.743845 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.743975 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.744105 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.744240 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.744384 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.744519 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.744648 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.744775 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.744902 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.745038 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.745173 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.745302 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.745436 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.745564 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.745691 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.745829 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.745968 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.746112 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.746241 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.746368 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.746497 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.746699 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.746831 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.746959 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.747093 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.747228 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.747875 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.748030 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.748174 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.748305 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.748449 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.748584 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.748714 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.748714 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.748970 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.748970 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.749219 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.749347 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.749475 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.749611 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.749740 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.749867 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.750001 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.750130 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.750268 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.750405 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.750534 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.750534 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.750774 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.750900 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.751035 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.751035 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.751284 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.751419 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.751548 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.751548 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.751903 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.752045 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.752174 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.752302 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.752438 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.752567 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.752704 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.752833 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.752962 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.753090 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.753218 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.753346 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.753549 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.753680 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.753809 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.753954 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.754085 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.754212 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.754351 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.754482 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.754617 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.754752 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.754881 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.755009 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.755148 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.755279 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.755413 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.755543 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.756756 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.756975 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.757209 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.757378 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.757574 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.757772 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.757966 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.758162 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.758395 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.758562 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.758790 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.758957 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.759151 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.759415 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.759654 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.759874 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.760069 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.760262 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.760458 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.760652 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.760896 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.761062 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.761256 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.761450 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.761643 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.761815 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.761988 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.762284 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.762450 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.762629 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.762770 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.762911 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.763676 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.763833 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.763977 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.764109 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.764239 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.764369 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.764498 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.764628 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.764776 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.764908 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.765074 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.765208 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.765337 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.765466 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.765608 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.765745 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.765876 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.766005 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.766135 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.766263 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.766401 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.766532 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.766678 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.766810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.766940 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.767079 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.767210 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.767339 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.767469 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.767605 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.767803 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.767950 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.768088 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.768231 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.768362 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.768491 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.768635 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.768779 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.768911 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.769048 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.769180 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.769310 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.769439 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.769577 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.769708 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.769837 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.769966 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.770095 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.770225 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.770440 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.770573 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.770703 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.770832 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.770961 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.771090 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.771231 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.771373 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.771514 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.771651 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.771819 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.771950 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.772080 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.772210 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.772362 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.772587 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.772751 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.772885 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.773020 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.773151 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.773289 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.773421 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.773550 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.773679 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.773808 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.773937 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.774074 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.774213 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.774353 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.774485 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.774614 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.774744 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.774881 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.775011 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] auth.external = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.775139 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] auth.external = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.775267 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.775432 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.775569 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.775753 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.775907 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.776046 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.776186 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] auth.password = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.776317 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] auth.password = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.776446 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] auth.token = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.776576 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] auth.token = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.776713 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.776851 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.777066 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.777200 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.777330 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.777460 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.777599 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.777731 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.777861 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.777991 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.778152 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.778289 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.778429 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.778560 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.779266 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] credential.caching = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.779430 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] credential.caching = True {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.779647 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.779919 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.780146 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.780363 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.780575 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.780790 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.781020 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.781232 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.781461 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.781735 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.781969 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.782170 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.782313 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.782445 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.782590 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.782724 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.782898 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.783112 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.783324 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.783504 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.783648 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.783834 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.784026 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.784173 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.784351 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.784487 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.784696 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.784921 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.785136 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.785347 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.785553 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] federation.caching = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.785761 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] federation.caching = True {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.785986 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.786198 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.786432 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.786658 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.786871 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.787084 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.787304 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.787517 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.787761 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.787914 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.788049 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.788192 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.788337 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.788478 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.788610 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.788741 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.788882 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.789012 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.789153 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.789284 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.789420 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.789551 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.789687 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] identity.caching = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.789826 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] identity.caching = True {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.790034 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.790169 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.790300 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.790430 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.790565 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.790717 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.790857 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.791605 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.792147 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.792284 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.792416 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.792564 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.792698 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.792828 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.792958 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.793088 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.793218 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.793358 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.793358 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.793617 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.793617 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.793864 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.793994 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.794132 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.794322 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.794961 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.795102 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.795233 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.795363 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.795503 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.795634 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.795789 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.795932 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.796063 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.796063 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.796320 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.796454 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.796583 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.796713 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.796842 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.796972 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.797109 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.797241 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.797371 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.797502 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.797662 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.797805 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.797945 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.798076 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.798206 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.798336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.798465 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.798596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.798734 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.798905 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.799041 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.799178 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.799310 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.799441 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.799590 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.799751 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.799888 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.800019 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.800149 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.800279 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.800419 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.800552 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.800682 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.800812 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.800948 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.801080 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.801218 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.801349 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.801488 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.801619 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.801749 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.801887 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.801887 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.802143 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.802272 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.802401 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.802530 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.802660 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.802799 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.802929 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.803083 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.803083 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.803364 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.803502 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.803502 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.803788 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.803931 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.803931 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.804178 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.804308 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.804308 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.user = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.804563 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.804693 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.804693 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.804947 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.805088 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.805088 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.805345 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.805345 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.805590 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.805761 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.805898 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.806035 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.user = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.806175 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.806306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.806437 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.806437 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.806690 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.806822 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.806973 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.807144 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.807317 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.807317 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.807717 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.808041 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.808278 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.808481 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.808678 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.808891 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.809128 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.809323 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.809486 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.809654 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.809894 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.810106 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.810297 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.810508 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.810706 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.810906 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.811112 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.811332 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.811567 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.811849 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.812070 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.812253 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.812433 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.812623 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.812810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.813021 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.813228 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.813228 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.813630 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.813789 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.813993 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.814135 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.814268 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.814399 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.814529 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.814660 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.814800 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.814943 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.815074 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.815204 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.815336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.815465 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.815603 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.815756 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.815894 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.816025 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.816155 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.816284 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.816428 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.816560 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] resource.caching = True {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.816691 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.816831 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.816962 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.817091 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.817229 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.817361 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.817492 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.817622 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.817758 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.817890 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.818029 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.818162 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.818292 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.818422 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.818562 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] resource.caching = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.818693 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.818832 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.818975 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.819106 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.819236 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] role.caching = True {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.819366 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.819497 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] role.driver = sql {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.819724 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.819865 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.819996 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.820127 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.820258 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.820388 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.820541 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.820675 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.820805 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.820935 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.821071 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.821202 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.821342 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] role.caching = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.821474 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.821474 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.821721 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] role.driver = sql {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.821850 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.821980 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.822117 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.822249 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.822390 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.822521 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.822651 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.822790 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.822922 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.823051 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.823182 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.823312 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.823312 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.823566 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.823759 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.823898 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.824029 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.824169 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.824299 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.824440 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.824572 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.824702 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.824833 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.824963 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.825093 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.825232 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.825364 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.825523 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.825523 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.825776 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.825917 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.826061 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.826194 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.826324 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.826454 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.826584 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.826716 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.826855 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.826987 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.827116 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.827246 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.827376 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.827506 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.827654 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.827821 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.827961 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.828092 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.828222 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.828352 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.828491 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.828623 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] token.caching = True {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.828753 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.828893 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.829025 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.829163 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.829294 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.829425 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.829565 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.829695 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.829825 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.829966 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.830097 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.830228 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.830357 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.830487 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.830617 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.830755 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.830755 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.831003 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] token.caching = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.831134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.831274 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.831404 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.831542 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.831674 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.831849 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.831980 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.831980 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.832226 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.832367 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.832498 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.832628 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.832757 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.832757 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.833002 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.833151 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.833283 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] database.connection = **** {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.833283 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.833547 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.833679 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.833808 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.833938 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.834067 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.834207 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.834207 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.834454 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.834584 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.834713 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.834842 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.835077 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.835212 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.835344 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.835474 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.835603 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.835750 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.835898 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.836031 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.836169 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] database.connection = **** {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.836311 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.836452 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.836584 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.836584 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.836838 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.836980 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.837110 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.837246 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.837378 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.837509 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.837647 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.837779 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.837779 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80075) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 18:51:04.838026 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.838026 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.838026 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.838026 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.838026 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.838026 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.838026 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.838026 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.838026 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.839120 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.839120 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.839120 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.839120 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:51:04.839120 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 18:51:04.842694 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:51:04.842920 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:51:04.843139 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:51:04.845576 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:51:04.845813 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:51:04.846042 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:51:04.853831 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:51:04.854359 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:51:04.884495 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:51:04.884758 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:51:04.884896 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:51:04.885043 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:51:04.937620 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:51:04.937939 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:51:04.990049 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:51:04.990373 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:51:04.992937 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:51:04.993172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:51:05.055474 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:51:05.055676 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:51:05.055838 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:51:05.055968 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:51:05.056116 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:51:05.056244 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:51:05.056385 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:51:05.056514 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:51:05.056639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:51:05.056778 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:51:05.056906 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:51:05.057173 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:51:05.079979 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:51:05.080188 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:51:05.080345 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:51:05.080481 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:51:05.080611 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:51:05.080756 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:51:05.080886 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:51:05.081033 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:51:05.081163 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:51:05.081291 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:51:05.081417 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:51:05.081569 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:51:05.081844 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:51:05.082120 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:51:05.092754 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:51:05.093612 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:51:05.105372 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:51:05.105604 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:51:05.105829 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:51:05.106000 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:51:05.106130 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:51:05.106258 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:51:05.106407 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:51:05.106546 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:51:05.106677 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80076) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:51:05.106835 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:51:05.107121 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:51:05.107399 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:51:05.107677 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:51:05.107974 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80075) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:51:05.123675 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.123906 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 27 18:51:05.124234 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.124414 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.124556 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 27 18:51:05.124686 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.124811 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 27 18:51:05.124950 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.125155 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.125305 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.125449 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.125624 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 27 18:51:05.125957 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.126279 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.126599 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.126918 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.134925 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.135198 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.135461 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.135755 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.136865 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.137207 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.137542 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.137884 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.143087 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:51:05.145399 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80075) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:51:05.147771 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:51:05.148047 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.148324 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.148604 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.148881 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.149136 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.149399 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.149669 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.149936 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.150203 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.150460 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.150853 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80075) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:51:05.151195 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.151538 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.151902 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.152246 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.152567 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.152897 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.153232 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.153563 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.154443 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.154773 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.174190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.175654 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:51:05.175954 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.178251 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.179816 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80075) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:51:05.180164 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.180494 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:51:05.180771 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.181048 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.185599 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80075) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:51:05.185946 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.186290 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.188137 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:51:05.188414 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.192527 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:51:05.192818 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.193100 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.193225 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80075) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:51:05.193377 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.193622 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.193759 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.193913 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.194186 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.194456 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.198125 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80075) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:51:05.198479 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.198824 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.199172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.199512 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.199876 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.200216 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.200575 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.210222 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.210494 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.214406 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:51:05.216547 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.216894 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.217546 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.217835 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.220978 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80075) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:51:05.222184 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:51:05.224267 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.224629 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.225339 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:51:05.228476 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.228770 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.229050 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.229307 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80075) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:51:05.229435 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.229602 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.229883 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.233273 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80075) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:51:05.236462 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.237071 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.237415 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.237773 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.238124 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.238482 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.246373 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:51:05.246653 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.246915 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.247168 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.254517 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.255152 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80075) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:51:05.255497 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.255848 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.256068 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.256241 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.256321 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.259080 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:51:05.259356 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.259639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.259954 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.260233 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.263427 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.265050 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.265384 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.268260 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80075) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:51:05.268601 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.268960 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.269301 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.269645 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.271568 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:51:05.271868 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.272147 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.272422 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.272697 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.272966 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.273250 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.281467 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80075) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:51:05.281811 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.282154 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.282494 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.282834 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.283173 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.283508 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.288569 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:51:05.291503 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:51:05.294934 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.297402 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.298880 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:51:05.299167 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.299439 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.299893 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80075) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:51:05.302863 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80075) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:51:05.305918 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.306012 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.307472 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:51:05.308523 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.310603 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80075) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:51:05.310910 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.311088 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.311179 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.311449 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.311548 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.311749 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.318018 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.319668 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:51:05.319775 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80075) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:51:05.319971 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.320241 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.322807 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.323162 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.323513 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.323878 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.327028 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80076) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:51:05.327305 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.327574 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.327865 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.328141 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.328413 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.328678 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.328938 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.329301 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.329579 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.329856 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.330126 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.330384 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.330636 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80076) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.332854 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80075) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:51:05.333211 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.333557 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.340382 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80075) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:51:05.340731 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.341586 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.342155 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.342290 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.342619 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.342953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.343287 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.343736 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.344084 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.344430 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.344770 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.345109 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.345434 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80075) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:51:05.364831 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555a1e3b79c0 pid: 80076 (default app) Jul 27 18:51:05.368101 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8daee2-5d42-4723-9dcd-2b8f05ddcd93 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:05.368386 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8daee2-5d42-4723-9dcd-2b8f05ddcd93 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:05.368656 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8daee2-5d42-4723-9dcd-2b8f05ddcd93 None None] PATH_INFO: `/v3` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:05.374635 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 791 bytes} [Wed Jul 27 18:51:05 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:05.379887 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555a1e3b79c0 pid: 80075 (default app) Jul 27 18:51:13.002580 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ef1f2-8b24-4715-8a70-890a08b31783 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:13.003137 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ef1f2-8b24-4715-8a70-890a08b31783 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:13.003137 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ef1f2-8b24-4715-8a70-890a08b31783 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:13.004730 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 2/2] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:51:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:51:13.011832 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a013478-0c4b-4ce5-8efc-45012cad7441 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:13.012275 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a013478-0c4b-4ce5-8efc-45012cad7441 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:13.012399 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a013478-0c4b-4ce5-8efc-45012cad7441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:13.083308 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: INFO dbcounter [None req-5a013478-0c4b-4ce5-8efc-45012cad7441 None None] Registered counter for database keystone Jul 27 18:51:13.104142 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG oslo_db.sqlalchemy.engines [None req-5a013478-0c4b-4ce5-8efc-45012cad7441 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80075) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 18:51:13.110328 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writer thread running {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 18:51:13.290745 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG passlib.handlers.bcrypt [None req-5a013478-0c4b-4ce5-8efc-45012cad7441 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80075) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 27 18:51:13.291073 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG passlib.handlers.bcrypt [None req-5a013478-0c4b-4ce5-8efc-45012cad7441 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80075) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 27 18:51:13.345025 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-5a013478-0c4b-4ce5-8efc-45012cad7441 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:51:13.346615 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-5a013478-0c4b-4ce5-8efc-45012cad7441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:13.490947 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 1/3] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:51:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 482 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 27 18:51:13.672542 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ef1f2-8b24-4715-8a70-890a08b31783 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:13.742600 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: INFO dbcounter [None req-106ef1f2-8b24-4715-8a70-890a08b31783 None None] Registered counter for database keystone Jul 27 18:51:13.765935 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG oslo_db.sqlalchemy.engines [None req-106ef1f2-8b24-4715-8a70-890a08b31783 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80076) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 18:51:13.772505 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writer thread running {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 18:51:13.893459 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ef1f2-8b24-4715-8a70-890a08b31783 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:13.897835 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e0fab1-660f-40b0-a71c-f378bebb743e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6643b58dd5014772a6237180b96549c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:13.898471 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e0fab1-660f-40b0-a71c-f378bebb743e admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:13.898750 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e0fab1-660f-40b0-a71c-f378bebb743e admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:13.899024 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e0fab1-660f-40b0-a71c-f378bebb743e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:13.907206 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e0fab1-660f-40b0-a71c-f378bebb743e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:13.958387 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: WARNING keystone.common.rbac_enforcer.enforcer [None req-55e0fab1-660f-40b0-a71c-f378bebb743e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 27 18:51:13.958658 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e0fab1-660f-40b0-a71c-f378bebb743e admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:13.968383 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 3/4] 10.222.0.20 () {58 vars in 1324 bytes} [Wed Jul 27 18:51:13 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 18:51:13.974256 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a013478-0c4b-4ce5-8efc-45012cad7441 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:13.990145 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a013478-0c4b-4ce5-8efc-45012cad7441 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:13.994606 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14124c84-cae0-4417-85e4-1c40424a2278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6643b58dd5014772a6237180b96549c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:13.995779 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14124c84-cae0-4417-85e4-1c40424a2278 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:13.996064 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14124c84-cae0-4417-85e4-1c40424a2278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:13.996335 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14124c84-cae0-4417-85e4-1c40424a2278 admin admin] PATH_INFO: `/v3/projects/6643b58dd5014772a6237180b96549c9` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:13.998650 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14124c84-cae0-4417-85e4-1c40424a2278 admin admin] RBAC: Authorizing `identity:get_project(project_id=6643b58dd5014772a6237180b96549c9)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:14.047956 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: WARNING keystone.common.rbac_enforcer.enforcer [None req-14124c84-cae0-4417-85e4-1c40424a2278 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 27 18:51:14.048511 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14124c84-cae0-4417-85e4-1c40424a2278 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:14.053025 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 2/5] 10.222.0.20 () {56 vars in 1207 bytes} [Wed Jul 27 18:51:13 2022] GET /identity/v3/projects/6643b58dd5014772a6237180b96549c9 => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:51:15.996071 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad535515-94bd-4c6e-93e4-60abe2978819 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:15.996588 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad535515-94bd-4c6e-93e4-60abe2978819 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:15.996684 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad535515-94bd-4c6e-93e4-60abe2978819 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:16.001240 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 4/6] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:51:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:51:16.006556 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7358419f-14a2-495d-a849-3d7c6bd2f0a1 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:16.006962 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7358419f-14a2-495d-a849-3d7c6bd2f0a1 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:16.007104 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7358419f-14a2-495d-a849-3d7c6bd2f0a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:16.027132 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-7358419f-14a2-495d-a849-3d7c6bd2f0a1 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:51:16.028679 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-7358419f-14a2-495d-a849-3d7c6bd2f0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:16.036331 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 3/7] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:51:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 27 18:51:16.057334 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad535515-94bd-4c6e-93e4-60abe2978819 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:16.069691 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad535515-94bd-4c6e-93e4-60abe2978819 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:16.073830 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c5274-6179-4abd-8dc6-5f3f57c7c7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6643b58dd5014772a6237180b96549c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:16.074427 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c5274-6179-4abd-8dc6-5f3f57c7c7c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:16.074710 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c5274-6179-4abd-8dc6-5f3f57c7c7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:16.074987 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c5274-6179-4abd-8dc6-5f3f57c7c7c8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:16.083104 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938c5274-6179-4abd-8dc6-5f3f57c7c7c8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:16.084901 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938c5274-6179-4abd-8dc6-5f3f57c7c7c8 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:16.093585 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 5/8] 10.222.0.20 () {58 vars in 1324 bytes} [Wed Jul 27 18:51:16 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 18:51:16.098687 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7358419f-14a2-495d-a849-3d7c6bd2f0a1 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:16.107458 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7358419f-14a2-495d-a849-3d7c6bd2f0a1 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:16.113323 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff017ff3-b546-4a63-b52d-1658c6d53a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6643b58dd5014772a6237180b96549c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:16.113955 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff017ff3-b546-4a63-b52d-1658c6d53a82 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:16.114231 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff017ff3-b546-4a63-b52d-1658c6d53a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:16.115204 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff017ff3-b546-4a63-b52d-1658c6d53a82 admin admin] PATH_INFO: `/v3/users/a75f20e26df34773ae258f20480b0b50` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:16.116617 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff017ff3-b546-4a63-b52d-1658c6d53a82 admin admin] RBAC: Authorizing `identity:get_user(user_id=a75f20e26df34773ae258f20480b0b50)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:16.120725 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff017ff3-b546-4a63-b52d-1658c6d53a82 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:16.122824 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 4/9] 10.222.0.20 () {56 vars in 1198 bytes} [Wed Jul 27 18:51:16 2022] GET /identity/v3/users/a75f20e26df34773ae258f20480b0b50 => generated 247 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:18.156946 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785979f-f130-43c9-a999-b27ffcc5830a None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:18.157484 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785979f-f130-43c9-a999-b27ffcc5830a None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:18.157484 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785979f-f130-43c9-a999-b27ffcc5830a None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:18.158805 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 6/10] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:51:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:51:18.163926 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c02be-b393-4938-9427-b9a49dfb0c77 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:18.164364 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c02be-b393-4938-9427-b9a49dfb0c77 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:18.164603 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c02be-b393-4938-9427-b9a49dfb0c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:18.183312 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-fd7c02be-b393-4938-9427-b9a49dfb0c77 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:51:18.185028 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-fd7c02be-b393-4938-9427-b9a49dfb0c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:18.214539 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486bdc05-65b7-49ec-8b74-acdb15e66747 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:18.214823 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486bdc05-65b7-49ec-8b74-acdb15e66747 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:18.215099 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486bdc05-65b7-49ec-8b74-acdb15e66747 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:18.216481 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 7/11] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:51:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:51:18.221169 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10648596-bb85-4ce0-a436-48c39ae8a11d None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:18.221454 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10648596-bb85-4ce0-a436-48c39ae8a11d None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:18.221731 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10648596-bb85-4ce0-a436-48c39ae8a11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:18.263199 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG passlib.handlers.bcrypt [None req-10648596-bb85-4ce0-a436-48c39ae8a11d None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80076) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 27 18:51:18.263623 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG passlib.handlers.bcrypt [None req-10648596-bb85-4ce0-a436-48c39ae8a11d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80076) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 27 18:51:18.263935 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 5/12] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:51:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:51:18.286265 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c02be-b393-4938-9427-b9a49dfb0c77 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:18.308453 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:18.308576 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-10648596-bb85-4ce0-a436-48c39ae8a11d None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:51:18.310675 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-10648596-bb85-4ce0-a436-48c39ae8a11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:18.386531 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c02be-b393-4938-9427-b9a49dfb0c77 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:18.411856 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 8/13] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:51:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:51:18.419428 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df99a5-a088-4f50-afab-92e4264128f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:18.420094 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df99a5-a088-4f50-afab-92e4264128f0 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:18.420376 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df99a5-a088-4f50-afab-92e4264128f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:18.420648 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df99a5-a088-4f50-afab-92e4264128f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:18.431329 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8df99a5-a088-4f50-afab-92e4264128f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:51:18.432938 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10648596-bb85-4ce0-a436-48c39ae8a11d None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:18.440560 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-e8df99a5-a088-4f50-afab-92e4264128f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:51:18.440560 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:51:18.440560 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:51:18.440560 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:51:18.440560 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:51:18.440560 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:51:18.440560 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:51:18.440560 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:51:18.440560 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:51:18.440560 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:51:18.440560 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:51:18.440560 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:51:18.440560 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:51:18.440560 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:51:18.440560 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:51:18.440560 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:51:18.441576 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:51:18.441576 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:51:18.441576 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:51:18.441576 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:51:18.441576 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:51:18.441576 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:51:18.441576 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:51:18.441576 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:51:18.441576 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:51:18.441576 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:51:18.441576 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:51:18.441576 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:51:18.441576 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:51:18.441576 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:51:18.441576 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:51:18.441576 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:51:18.442377 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:51:18.442377 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:51:18.442377 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:51:18.442377 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:51:18.442377 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:51:18.442377 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:51:18.442377 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:51:18.442377 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:51:18.442377 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:51:18.442377 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:51:18.442377 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:51:18.442377 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:51:18.442377 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 6/14] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 27 18:51:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:51:18.447395 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df99a5-a088-4f50-afab-92e4264128f0 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:18.527017 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:18.534320 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10648596-bb85-4ce0-a436-48c39ae8a11d None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:18.536700 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:18.546879 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df99a5-a088-4f50-afab-92e4264128f0 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:18.571569 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb1da02-1197-4d9a-9715-577c6b952483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:18.572452 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1da02-1197-4d9a-9715-577c6b952483 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:18.572732 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1da02-1197-4d9a-9715-577c6b952483 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:18.572999 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1da02-1197-4d9a-9715-577c6b952483 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:18.580192 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c03b4-9981-4ede-9c70-6e7528b7fa30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:18.580802 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c03b4-9981-4ede-9c70-6e7528b7fa30 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:18.581079 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c03b4-9981-4ede-9c70-6e7528b7fa30 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:18.581747 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c03b4-9981-4ede-9c70-6e7528b7fa30 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:18.582466 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4c03b4-9981-4ede-9c70-6e7528b7fa30 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:51:18.582768 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4c03b4-9981-4ede-9c70-6e7528b7fa30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:18.584190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4c03b4-9981-4ede-9c70-6e7528b7fa30 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:18.595815 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 7/15] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 27 18:51:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:51:18.601464 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c03b4-9981-4ede-9c70-6e7528b7fa30 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:18.639117 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb1da02-1197-4d9a-9715-577c6b952483 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:18.640651 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb1da02-1197-4d9a-9715-577c6b952483 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:18.698539 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c03b4-9981-4ede-9c70-6e7528b7fa30 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:18.741155 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 9/16] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 27 18:51:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 18:51:18.747712 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb1da02-1197-4d9a-9715-577c6b952483 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:18.750937 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:18.836805 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb83e0a-5b5d-48ad-b38b-480f9de9f5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:18.837437 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb83e0a-5b5d-48ad-b38b-480f9de9f5b4 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:18.837717 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb83e0a-5b5d-48ad-b38b-480f9de9f5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:18.837992 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb83e0a-5b5d-48ad-b38b-480f9de9f5b4 None admin] PATH_INFO: `/v3/users/a75f20e26df34773ae258f20480b0b50` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:18.839152 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb83e0a-5b5d-48ad-b38b-480f9de9f5b4 None admin] RBAC: Authorizing `identity:get_user(user_id=a75f20e26df34773ae258f20480b0b50)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:18.841165 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb83e0a-5b5d-48ad-b38b-480f9de9f5b4 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:18.842729 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 8/17] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 27 18:51:18 2022] GET /identity/v3/users/a75f20e26df34773ae258f20480b0b50 => generated 247 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:51:18.848063 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb83e0a-5b5d-48ad-b38b-480f9de9f5b4 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:18.848630 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb1da02-1197-4d9a-9715-577c6b952483 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:18.863415 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:18.883922 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d89d4ad-441d-4950-a2e8-6123c3deb37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:18.884759 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89d4ad-441d-4950-a2e8-6123c3deb37a None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:18.885043 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89d4ad-441d-4950-a2e8-6123c3deb37a None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:18.885314 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89d4ad-441d-4950-a2e8-6123c3deb37a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:18.902956 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d89d4ad-441d-4950-a2e8-6123c3deb37a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:18.904941 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d89d4ad-441d-4950-a2e8-6123c3deb37a None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:18.923133 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-0d89d4ad-441d-4950-a2e8-6123c3deb37a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:51:18.923133 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:51:18.923133 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:51:18.923133 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:51:18.923133 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:51:18.923133 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:51:18.923133 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:51:18.923133 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:51:18.923133 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:51:18.923133 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:51:18.923133 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:51:18.923133 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:51:18.923133 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:51:18.923133 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:51:18.923133 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:51:18.924166 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:51:18.924166 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:51:18.924166 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:51:18.924166 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:51:18.924166 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:51:18.924166 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:51:18.924166 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:51:18.924166 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:51:18.924166 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:51:18.924166 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:51:18.924166 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:51:18.924166 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:51:18.924166 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:51:18.924166 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:51:18.924166 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:51:18.924166 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:51:18.924166 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:51:18.924949 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:51:18.924949 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:51:18.924949 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:51:18.924949 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:51:18.924949 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 10/18] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:51:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:51:18.930165 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d89d4ad-441d-4950-a2e8-6123c3deb37a None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:18.947956 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb83e0a-5b5d-48ad-b38b-480f9de9f5b4 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:18.986999 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e92dc04-c874-4a14-b89a-ba7b792551d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:18.987564 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92dc04-c874-4a14-b89a-ba7b792551d8 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:18.987942 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92dc04-c874-4a14-b89a-ba7b792551d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:18.988231 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92dc04-c874-4a14-b89a-ba7b792551d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:18.989367 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e92dc04-c874-4a14-b89a-ba7b792551d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:18.989491 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:18.990801 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e92dc04-c874-4a14-b89a-ba7b792551d8 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:18.992395 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 9/19] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:51:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:51:18.998046 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e92dc04-c874-4a14-b89a-ba7b792551d8 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:19.033491 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d89d4ad-441d-4950-a2e8-6123c3deb37a None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:19.066331 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef1bb9-aa7f-498a-a9d8-a3d43d25c7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:19.066942 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef1bb9-aa7f-498a-a9d8-a3d43d25c7ab None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:19.067226 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef1bb9-aa7f-498a-a9d8-a3d43d25c7ab None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:19.067501 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef1bb9-aa7f-498a-a9d8-a3d43d25c7ab None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:19.068235 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef1bb9-aa7f-498a-a9d8-a3d43d25c7ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:51:19.068543 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef1bb9-aa7f-498a-a9d8-a3d43d25c7ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:19.069923 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef1bb9-aa7f-498a-a9d8-a3d43d25c7ab None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:19.075927 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:19.087131 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 11/20] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:51:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:51:19.095605 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e92dc04-c874-4a14-b89a-ba7b792551d8 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:19.131856 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b60d69-e85e-4342-84a2-9c28c6207354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:19.132498 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b60d69-e85e-4342-84a2-9c28c6207354 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:19.132788 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b60d69-e85e-4342-84a2-9c28c6207354 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:19.133065 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b60d69-e85e-4342-84a2-9c28c6207354 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:19.133891 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b60d69-e85e-4342-84a2-9c28c6207354 None admin] RBAC: Adding query filter params (role.id=0f4a39b061e148418413cfe647af9a34, scope.domain.id=default, user.id=a75f20e26df34773ae258f20480b0b50) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:51:19.134206 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b60d69-e85e-4342-84a2-9c28c6207354 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:19.135731 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b60d69-e85e-4342-84a2-9c28c6207354 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:19.143439 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 10/21] 10.222.0.20 () {56 vars in 1322 bytes} [Wed Jul 27 18:51:18 2022] GET /identity/v3/role_assignments?user.id=a75f20e26df34773ae258f20480b0b50&scope.domain.id=default&role.id=0f4a39b061e148418413cfe647af9a34 => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:51:21.528678 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c19831-ad2d-4530-8445-733bc905eb3a None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:21.529198 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c19831-ad2d-4530-8445-733bc905eb3a None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:21.529483 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c19831-ad2d-4530-8445-733bc905eb3a None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:21.531017 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 12/22] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:51:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:51:21.536720 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f791aca-12b7-4ab7-87f3-2f906f0b8b42 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:21.537112 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f791aca-12b7-4ab7-87f3-2f906f0b8b42 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:21.537290 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f791aca-12b7-4ab7-87f3-2f906f0b8b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:21.565324 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-7f791aca-12b7-4ab7-87f3-2f906f0b8b42 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:51:21.566787 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-7f791aca-12b7-4ab7-87f3-2f906f0b8b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:21.639953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764bb693-70a1-42e5-bcce-f709c4d93c3e None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:21.640464 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764bb693-70a1-42e5-bcce-f709c4d93c3e None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:21.640902 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764bb693-70a1-42e5-bcce-f709c4d93c3e None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:21.642386 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 13/23] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:51:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:51:21.647235 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a2f97-2747-4094-9bb2-fa224b39c8eb None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:21.647522 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a2f97-2747-4094-9bb2-fa224b39c8eb None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:21.647830 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a2f97-2747-4094-9bb2-fa224b39c8eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:21.679884 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-9a8a2f97-2747-4094-9bb2-fa224b39c8eb None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:51:21.681100 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-9a8a2f97-2747-4094-9bb2-fa224b39c8eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:21.704973 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 11/24] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:51:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:51:21.790945 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 14/25] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:51:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:51:21.794034 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f791aca-12b7-4ab7-87f3-2f906f0b8b42 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:21.830264 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b164b-bd5d-4b8d-8c77-a1eb13920098 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:21.830774 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b164b-bd5d-4b8d-8c77-a1eb13920098 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:21.831223 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b164b-bd5d-4b8d-8c77-a1eb13920098 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:21.832751 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 15/26] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:51:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:51:21.833631 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b164b-bd5d-4b8d-8c77-a1eb13920098 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:21.921890 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:21.933118 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:21.975393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f791aca-12b7-4ab7-87f3-2f906f0b8b42 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:22.030703 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b164b-bd5d-4b8d-8c77-a1eb13920098 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:22.044573 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b32b3fd-3bc1-4e8a-88ae-31933f6162ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:22.045442 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32b3fd-3bc1-4e8a-88ae-31933f6162ae None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:22.045863 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32b3fd-3bc1-4e8a-88ae-31933f6162ae None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:22.046284 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32b3fd-3bc1-4e8a-88ae-31933f6162ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:22.063566 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b32b3fd-3bc1-4e8a-88ae-31933f6162ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:51:22.069181 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-5b32b3fd-3bc1-4e8a-88ae-31933f6162ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:51:22.069181 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:51:22.069181 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:51:22.069181 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:51:22.069181 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:51:22.069181 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:51:22.069181 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:51:22.069181 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:51:22.069181 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:51:22.069181 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:51:22.069181 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:51:22.069181 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:51:22.069181 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:51:22.069181 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:51:22.069181 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:51:22.069181 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:51:22.070245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:51:22.070245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:51:22.070245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:51:22.070245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:51:22.070245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:51:22.070245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:51:22.070245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:51:22.070245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:51:22.070245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:51:22.070245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:51:22.070245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:51:22.070245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:51:22.070245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:51:22.070245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:51:22.070245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:51:22.070245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:51:22.071191 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:51:22.071191 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:51:22.071191 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:51:22.071191 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:51:22.071191 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:51:22.071191 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:51:22.071191 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:51:22.071191 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:51:22.071191 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:51:22.071191 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:51:22.071191 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:51:22.071191 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:51:22.073318 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 12/27] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 27 18:51:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:51:22.075910 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d34c81-d28f-4604-a93c-93c1f52a5eb6 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:22.076441 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d34c81-d28f-4604-a93c-93c1f52a5eb6 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:22.076851 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d34c81-d28f-4604-a93c-93c1f52a5eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:22.085127 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987cdd8c-fda5-42f3-9814-b7b21c457258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:22.085862 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987cdd8c-fda5-42f3-9814-b7b21c457258 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:22.086332 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987cdd8c-fda5-42f3-9814-b7b21c457258 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:22.086787 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987cdd8c-fda5-42f3-9814-b7b21c457258 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:22.095555 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-62d34c81-d28f-4604-a93c-93c1f52a5eb6 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:51:22.096981 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-62d34c81-d28f-4604-a93c-93c1f52a5eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:22.097718 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987cdd8c-fda5-42f3-9814-b7b21c457258 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:22.099265 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987cdd8c-fda5-42f3-9814-b7b21c457258 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:22.116799 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-987cdd8c-fda5-42f3-9814-b7b21c457258 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:51:22.116799 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:51:22.116799 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:51:22.116799 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:51:22.116799 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:51:22.116799 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:51:22.116799 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:51:22.116799 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:51:22.116799 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:51:22.116799 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:51:22.116799 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:51:22.116799 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:51:22.116799 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:51:22.116799 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:51:22.116799 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:51:22.122564 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:51:22.122564 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:51:22.122564 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:51:22.122564 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:51:22.122564 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:51:22.122564 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:51:22.122564 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:51:22.122564 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:51:22.122564 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:51:22.122564 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:51:22.122564 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:51:22.122564 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:51:22.122564 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:51:22.122564 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:51:22.122564 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:51:22.122564 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:51:22.122564 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:51:22.123582 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:51:22.123582 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:51:22.123582 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:51:22.123582 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:51:22.126832 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 16/28] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:51:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:51:22.129198 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18c3a6-7005-48d5-bf5e-d1d4ebd7f59e None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:22.129756 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18c3a6-7005-48d5-bf5e-d1d4ebd7f59e None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:22.130166 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18c3a6-7005-48d5-bf5e-d1d4ebd7f59e None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:22.131735 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 17/29] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:51:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:51:22.135120 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f18c3a6-7005-48d5-bf5e-d1d4ebd7f59e None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:22.191889 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 13/30] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:51:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:51:22.193651 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d34c81-d28f-4604-a93c-93c1f52a5eb6 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:22.247994 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:22.253558 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f18c3a6-7005-48d5-bf5e-d1d4ebd7f59e None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:22.279680 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:22.326322 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d34c81-d28f-4604-a93c-93c1f52a5eb6 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:22.364618 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3b511-25d7-4102-a658-983693b1ac27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:22.365412 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3b511-25d7-4102-a658-983693b1ac27 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:22.365789 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3b511-25d7-4102-a658-983693b1ac27 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:22.366179 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3b511-25d7-4102-a658-983693b1ac27 None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:22.366990 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c3b511-25d7-4102-a658-983693b1ac27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:51:22.367398 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c3b511-25d7-4102-a658-983693b1ac27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:22.368999 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c3b511-25d7-4102-a658-983693b1ac27 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:22.389157 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 14/31] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:51:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:22.390688 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b3458-74c0-46e9-bd2e-c017daacd0fb None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:22.391073 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b3458-74c0-46e9-bd2e-c017daacd0fb None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:22.391448 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b3458-74c0-46e9-bd2e-c017daacd0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:22.408021 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade97319-b54a-44c9-8b33-8ae633bad4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:22.408976 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade97319-b54a-44c9-8b33-8ae633bad4ec None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:22.409394 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade97319-b54a-44c9-8b33-8ae633bad4ec None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:22.409817 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade97319-b54a-44c9-8b33-8ae633bad4ec None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:22.410680 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade97319-b54a-44c9-8b33-8ae633bad4ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:51:22.411117 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade97319-b54a-44c9-8b33-8ae633bad4ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:22.411774 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-b69b3458-74c0-46e9-bd2e-c017daacd0fb None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:51:22.412794 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade97319-b54a-44c9-8b33-8ae633bad4ec None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:22.413270 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-b69b3458-74c0-46e9-bd2e-c017daacd0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:22.427277 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 18/32] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 27 18:51:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:22.428281 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade97319-b54a-44c9-8b33-8ae633bad4ec None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:22.490297 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 15/33] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:51:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:51:22.491614 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b3458-74c0-46e9-bd2e-c017daacd0fb None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:22.544107 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade97319-b54a-44c9-8b33-8ae633bad4ec None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:22.568152 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:22.583234 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2f172-7ff3-4c29-ab72-9cdbdf02bd62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:22.583838 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2f172-7ff3-4c29-ab72-9cdbdf02bd62 None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:22.584121 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2f172-7ff3-4c29-ab72-9cdbdf02bd62 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:22.584392 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2f172-7ff3-4c29-ab72-9cdbdf02bd62 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:22.585104 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b2f172-7ff3-4c29-ab72-9cdbdf02bd62 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:22.586472 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b2f172-7ff3-4c29-ab72-9cdbdf02bd62 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:22.620990 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b3458-74c0-46e9-bd2e-c017daacd0fb None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:22.664017 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee42b0dc-5203-4fac-8525-d8e94b5e8482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:22.664752 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee42b0dc-5203-4fac-8525-d8e94b5e8482 None admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:22.665089 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee42b0dc-5203-4fac-8525-d8e94b5e8482 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:22.665373 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee42b0dc-5203-4fac-8525-d8e94b5e8482 None admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:22.666097 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee42b0dc-5203-4fac-8525-d8e94b5e8482 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:22.667670 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee42b0dc-5203-4fac-8525-d8e94b5e8482 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:22.737363 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 19/34] 10.222.0.20 () {60 vars in 1131 bytes} [Wed Jul 27 18:51:22 2022] POST /identity/v3/roles => generated 225 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:51:22.739867 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2f172-7ff3-4c29-ab72-9cdbdf02bd62 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:22.780092 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:22.824067 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 16/35] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Jul 27 18:51:22 2022] POST /identity/v3/projects => generated 301 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:51:22.825808 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee42b0dc-5203-4fac-8525-d8e94b5e8482 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:22.915473 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2f172-7ff3-4c29-ab72-9cdbdf02bd62 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:22.965530 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238731a4-aa50-49ed-b1ff-a663f3702939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:22.966579 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238731a4-aa50-49ed-b1ff-a663f3702939 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:22.967086 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238731a4-aa50-49ed-b1ff-a663f3702939 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:22.967558 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238731a4-aa50-49ed-b1ff-a663f3702939 None admin] PATH_INFO: `/v3/users/a75f20e26df34773ae258f20480b0b50` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:22.970185 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238731a4-aa50-49ed-b1ff-a663f3702939 None admin] RBAC: Authorizing `identity:get_user(user_id=a75f20e26df34773ae258f20480b0b50)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:22.972115 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238731a4-aa50-49ed-b1ff-a663f3702939 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:22.978771 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 20/36] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 27 18:51:22 2022] GET /identity/v3/users/a75f20e26df34773ae258f20480b0b50 => generated 247 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:22.980711 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0572ab3-dd7c-4627-95a6-a83dbc22f112 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:22.981751 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0572ab3-dd7c-4627-95a6-a83dbc22f112 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:22.982239 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0572ab3-dd7c-4627-95a6-a83dbc22f112 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:22.983867 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 21/37] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:51:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:51:22.986201 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0572ab3-dd7c-4627-95a6-a83dbc22f112 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:22.991569 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee42b0dc-5203-4fac-8525-d8e94b5e8482 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:23.002229 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:23.048808 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab71d902-f0c9-40fe-96aa-606cdd41ad23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:23.049506 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71d902-f0c9-40fe-96aa-606cdd41ad23 None admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:23.049796 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71d902-f0c9-40fe-96aa-606cdd41ad23 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:23.050078 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71d902-f0c9-40fe-96aa-606cdd41ad23 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:23.050837 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab71d902-f0c9-40fe-96aa-606cdd41ad23 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:23.052424 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab71d902-f0c9-40fe-96aa-606cdd41ad23 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:23.072680 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 17/38] 10.222.0.20 () {60 vars in 1131 bytes} [Wed Jul 27 18:51:22 2022] POST /identity/v3/roles => generated 219 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:51:23.073793 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76fd71-39aa-4748-9542-569d49636021 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:23.074091 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76fd71-39aa-4748-9542-569d49636021 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:23.074369 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76fd71-39aa-4748-9542-569d49636021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:23.115026 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:23.124897 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-bf76fd71-39aa-4748-9542-569d49636021 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:51:23.126519 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-bf76fd71-39aa-4748-9542-569d49636021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:23.138963 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0572ab3-dd7c-4627-95a6-a83dbc22f112 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:23.179675 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5070d07-0cbe-4748-b59e-e366437a931c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:23.180716 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5070d07-0cbe-4748-b59e-e366437a931c None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:23.181272 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5070d07-0cbe-4748-b59e-e366437a931c None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:23.182317 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5070d07-0cbe-4748-b59e-e366437a931c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:23.184135 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5070d07-0cbe-4748-b59e-e366437a931c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:23.185925 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5070d07-0cbe-4748-b59e-e366437a931c None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:23.189428 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 22/39] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:51:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:23.196395 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5070d07-0cbe-4748-b59e-e366437a931c None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:23.227712 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 18/40] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:51:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:51:23.249511 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9597f7-2510-46d1-8c30-a2f86a894a35 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:23.249802 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9597f7-2510-46d1-8c30-a2f86a894a35 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:23.250085 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9597f7-2510-46d1-8c30-a2f86a894a35 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:23.251481 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 19/41] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:51:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:51:23.257021 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ca19a-55a7-47a5-8af7-7d5bb34e753f None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:23.257364 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ca19a-55a7-47a5-8af7-7d5bb34e753f None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:23.257712 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ca19a-55a7-47a5-8af7-7d5bb34e753f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:23.276596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-293ca19a-55a7-47a5-8af7-7d5bb34e753f None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:51:23.278509 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-293ca19a-55a7-47a5-8af7-7d5bb34e753f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:23.326023 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5070d07-0cbe-4748-b59e-e366437a931c None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:23.354139 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 20/42] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:51:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:51:23.357037 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ca19a-55a7-47a5-8af7-7d5bb34e753f None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:23.364436 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e3fb9-0230-4f2e-be46-80ef76cdd893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:23.365110 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e3fb9-0230-4f2e-be46-80ef76cdd893 None admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:23.365403 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e3fb9-0230-4f2e-be46-80ef76cdd893 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:23.365669 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e3fb9-0230-4f2e-be46-80ef76cdd893 None admin] PATH_INFO: `/v3/domains/default/users/a75f20e26df34773ae258f20480b0b50/roles/0f4a39b061e148418413cfe647af9a34` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:23.368838 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3e3fb9-0230-4f2e-be46-80ef76cdd893 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=a75f20e26df34773ae258f20480b0b50, role_id=0f4a39b061e148418413cfe647af9a34)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:23.370641 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3e3fb9-0230-4f2e-be46-80ef76cdd893 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:23.388325 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:23.389088 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 23/43] 10.222.0.20 () {58 vars in 1361 bytes} [Wed Jul 27 18:51:23 2022] PUT /identity/v3/domains/default/users/a75f20e26df34773ae258f20480b0b50/roles/0f4a39b061e148418413cfe647af9a34 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:51:23.391050 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e3fb9-0230-4f2e-be46-80ef76cdd893 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:23.422849 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:23.486363 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ca19a-55a7-47a5-8af7-7d5bb34e753f None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:23.520796 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e3fb9-0230-4f2e-be46-80ef76cdd893 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:23.535559 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02796fcd-fa4b-478c-a55d-5022d365ec16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:23.535728 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02796fcd-fa4b-478c-a55d-5022d365ec16 None admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:23.537506 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02796fcd-fa4b-478c-a55d-5022d365ec16 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:23.537506 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02796fcd-fa4b-478c-a55d-5022d365ec16 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:23.538143 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02796fcd-fa4b-478c-a55d-5022d365ec16 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:23.539337 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02796fcd-fa4b-478c-a55d-5022d365ec16 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:23.565219 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 21/44] 10.222.0.20 () {60 vars in 1131 bytes} [Wed Jul 27 18:51:23 2022] POST /identity/v3/roles => generated 223 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:51:23.568556 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b98b67b-bada-4f8f-9733-05dee59d5e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:23.569309 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98b67b-bada-4f8f-9733-05dee59d5e40 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:23.569590 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98b67b-bada-4f8f-9733-05dee59d5e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:23.569913 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98b67b-bada-4f8f-9733-05dee59d5e40 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:23.571332 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b98b67b-bada-4f8f-9733-05dee59d5e40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:23.572942 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b98b67b-bada-4f8f-9733-05dee59d5e40 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:23.575520 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 24/45] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:51:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:23.581233 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02796fcd-fa4b-478c-a55d-5022d365ec16 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:23.678844 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:23.697238 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02796fcd-fa4b-478c-a55d-5022d365ec16 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:23.736238 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a349aa-0f62-4884-aab1-b24e693f8deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:23.737176 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a349aa-0f62-4884-aab1-b24e693f8deb None admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:23.738246 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a349aa-0f62-4884-aab1-b24e693f8deb None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:23.738246 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a349aa-0f62-4884-aab1-b24e693f8deb None admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:23.738413 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a349aa-0f62-4884-aab1-b24e693f8deb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:23.739805 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a349aa-0f62-4884-aab1-b24e693f8deb None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:23.768246 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 22/46] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Jul 27 18:51:23 2022] POST /identity/v3/projects => generated 312 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:51:25.408523 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171d856-84f7-4103-bc9e-ec9ee596f728 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:25.409062 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171d856-84f7-4103-bc9e-ec9ee596f728 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:25.409062 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171d856-84f7-4103-bc9e-ec9ee596f728 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:25.410560 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 25/47] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:51:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:51:25.415518 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18dbc86-3c6c-41e4-bb79-d14504868c88 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:25.415919 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18dbc86-3c6c-41e4-bb79-d14504868c88 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:25.416226 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18dbc86-3c6c-41e4-bb79-d14504868c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:25.434460 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-a18dbc86-3c6c-41e4-bb79-d14504868c88 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:51:25.435657 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-a18dbc86-3c6c-41e4-bb79-d14504868c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:25.500503 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 23/48] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:51:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:51:25.524249 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8171d856-84f7-4103-bc9e-ec9ee596f728 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:25.608606 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:25.626223 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8171d856-84f7-4103-bc9e-ec9ee596f728 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:25.658786 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928a51f-c187-411d-9830-c9f2fb3dd8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:25.659363 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928a51f-c187-411d-9830-c9f2fb3dd8cf None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:25.659648 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928a51f-c187-411d-9830-c9f2fb3dd8cf None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:25.659966 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928a51f-c187-411d-9830-c9f2fb3dd8cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:25.671284 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6928a51f-c187-411d-9830-c9f2fb3dd8cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:51:25.677404 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-6928a51f-c187-411d-9830-c9f2fb3dd8cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:51:25.677404 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:51:25.677404 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:51:25.677404 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:51:25.677404 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:51:25.677404 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:51:25.677404 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:51:25.677404 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:51:25.677404 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:51:25.677404 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:51:25.677404 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:51:25.677404 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:51:25.677404 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:51:25.677404 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:51:25.677404 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:51:25.677404 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:51:25.678382 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:51:25.678382 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:51:25.678382 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:51:25.678382 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:51:25.678382 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:51:25.678382 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:51:25.678382 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:51:25.678382 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:51:25.678382 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:51:25.678382 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:51:25.678382 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:51:25.678382 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:51:25.678382 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:51:25.678382 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:51:25.678382 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:51:25.678382 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:51:25.679221 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:51:25.679221 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:51:25.679221 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:51:25.679221 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:51:25.679221 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:51:25.679221 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:51:25.679221 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:51:25.679221 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:51:25.679221 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:51:25.679221 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:51:25.679221 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:51:25.679221 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:51:25.679221 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 26/49] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 27 18:51:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:51:25.685869 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18dbc86-3c6c-41e4-bb79-d14504868c88 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:25.750220 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:25.751808 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763047a1-8646-412e-a5ec-f8afd6b8a4c2 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:25.752100 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763047a1-8646-412e-a5ec-f8afd6b8a4c2 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:25.752353 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763047a1-8646-412e-a5ec-f8afd6b8a4c2 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:25.753696 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 27/50] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:51:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:51:25.758778 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9a203-d4c4-442f-a41e-fdb27da167c2 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:25.759065 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9a203-d4c4-442f-a41e-fdb27da167c2 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:25.759343 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9a203-d4c4-442f-a41e-fdb27da167c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:25.777892 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-cad9a203-d4c4-442f-a41e-fdb27da167c2 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:51:25.779410 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-cad9a203-d4c4-442f-a41e-fdb27da167c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:25.784923 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18dbc86-3c6c-41e4-bb79-d14504868c88 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:25.818077 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab71afb1-9012-4eda-a97a-e921df263b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:25.818686 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71afb1-9012-4eda-a97a-e921df263b1c None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:25.818964 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71afb1-9012-4eda-a97a-e921df263b1c None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:25.819234 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71afb1-9012-4eda-a97a-e921df263b1c None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:25.819981 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab71afb1-9012-4eda-a97a-e921df263b1c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:51:25.820279 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab71afb1-9012-4eda-a97a-e921df263b1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:25.821634 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab71afb1-9012-4eda-a97a-e921df263b1c None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:25.830410 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 24/51] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 27 18:51:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:25.835869 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab71afb1-9012-4eda-a97a-e921df263b1c None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:25.847387 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 28/52] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:51:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:51:25.869790 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad9a203-d4c4-442f-a41e-fdb27da167c2 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:25.932306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab71afb1-9012-4eda-a97a-e921df263b1c None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:25.942857 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:25.959500 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:25.965688 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac94bfa-06de-4fc8-a3e8-4d6a108c1cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:25.966318 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac94bfa-06de-4fc8-a3e8-4d6a108c1cbd None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:25.966596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac94bfa-06de-4fc8-a3e8-4d6a108c1cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:25.966871 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac94bfa-06de-4fc8-a3e8-4d6a108c1cbd None admin] PATH_INFO: `/v3/users/a75f20e26df34773ae258f20480b0b50` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:25.967886 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad9a203-d4c4-442f-a41e-fdb27da167c2 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:25.968056 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac94bfa-06de-4fc8-a3e8-4d6a108c1cbd None admin] RBAC: Authorizing `identity:get_user(user_id=a75f20e26df34773ae258f20480b0b50)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:25.969489 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac94bfa-06de-4fc8-a3e8-4d6a108c1cbd None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:25.971073 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 25/53] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 27 18:51:25 2022] GET /identity/v3/users/a75f20e26df34773ae258f20480b0b50 => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:51:25.976389 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac94bfa-06de-4fc8-a3e8-4d6a108c1cbd None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:26.002029 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e7df3-c20e-41ac-bb6f-40b570046c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:26.002676 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e7df3-c20e-41ac-bb6f-40b570046c03 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:26.002963 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e7df3-c20e-41ac-bb6f-40b570046c03 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:26.003246 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e7df3-c20e-41ac-bb6f-40b570046c03 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:26.004419 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48e7df3-c20e-41ac-bb6f-40b570046c03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:26.005864 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48e7df3-c20e-41ac-bb6f-40b570046c03 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:26.007442 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 29/54] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:51:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:26.013376 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e7df3-c20e-41ac-bb6f-40b570046c03 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:26.074176 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac94bfa-06de-4fc8-a3e8-4d6a108c1cbd None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:26.107203 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ed532-f70a-4aec-bb86-4a888fb41cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:26.107866 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ed532-f70a-4aec-bb86-4a888fb41cc3 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:26.108156 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ed532-f70a-4aec-bb86-4a888fb41cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:26.108434 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ed532-f70a-4aec-bb86-4a888fb41cc3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:26.109416 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e7df3-c20e-41ac-bb6f-40b570046c03 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:26.109593 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ed532-f70a-4aec-bb86-4a888fb41cc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:26.111034 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ed532-f70a-4aec-bb86-4a888fb41cc3 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:26.112915 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 26/55] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:51:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:51:26.118603 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ed532-f70a-4aec-bb86-4a888fb41cc3 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:26.144041 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e8596d-c0e9-4a8e-a425-d699bb705d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:26.144657 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8596d-c0e9-4a8e-a425-d699bb705d56 None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:26.144938 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8596d-c0e9-4a8e-a425-d699bb705d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:26.145209 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8596d-c0e9-4a8e-a425-d699bb705d56 None admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:26.145882 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e8596d-c0e9-4a8e-a425-d699bb705d56 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:26.147381 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e8596d-c0e9-4a8e-a425-d699bb705d56 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:26.161673 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:26.175301 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 30/56] 10.222.0.20 () {60 vars in 1140 bytes} [Wed Jul 27 18:51:26 2022] POST /identity/v3/projects => generated 298 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:51:26.183130 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:26.224210 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ed532-f70a-4aec-bb86-4a888fb41cc3 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:26.260160 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563b647-a003-4b12-833f-770ead56795b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:26.260792 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563b647-a003-4b12-833f-770ead56795b None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:26.261080 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563b647-a003-4b12-833f-770ead56795b None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:26.261361 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563b647-a003-4b12-833f-770ead56795b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:26.262724 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8563b647-a003-4b12-833f-770ead56795b None admin] RBAC: Adding query filter params (role.id=0f4a39b061e148418413cfe647af9a34, scope.domain.id=default, user.id=a75f20e26df34773ae258f20480b0b50) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:51:26.263042 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8563b647-a003-4b12-833f-770ead56795b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:26.264520 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8563b647-a003-4b12-833f-770ead56795b None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:26.271013 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 27/57] 10.222.0.20 () {56 vars in 1322 bytes} [Wed Jul 27 18:51:26 2022] GET /identity/v3/role_assignments?user.id=a75f20e26df34773ae258f20480b0b50&scope.domain.id=default&role.id=0f4a39b061e148418413cfe647af9a34 => generated 530 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:51:28.211613 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46583678-31e2-4b23-a4cc-67993b02182a None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:28.212162 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46583678-31e2-4b23-a4cc-67993b02182a None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:28.212244 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46583678-31e2-4b23-a4cc-67993b02182a None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:28.213529 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 31/58] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:51:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:51:28.219109 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042fed44-0b9b-4b38-b793-0564588c639a None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:28.219518 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042fed44-0b9b-4b38-b793-0564588c639a None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:28.219659 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042fed44-0b9b-4b38-b793-0564588c639a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:28.237317 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-042fed44-0b9b-4b38-b793-0564588c639a None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:51:28.238474 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-042fed44-0b9b-4b38-b793-0564588c639a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:28.300560 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 28/59] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:51:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:51:28.323781 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46583678-31e2-4b23-a4cc-67993b02182a None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:28.421124 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46583678-31e2-4b23-a4cc-67993b02182a None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:28.452796 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1abf3b8-cf25-403d-9730-bbf6b8d42571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:28.453416 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abf3b8-cf25-403d-9730-bbf6b8d42571 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:28.453695 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abf3b8-cf25-403d-9730-bbf6b8d42571 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:28.453970 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abf3b8-cf25-403d-9730-bbf6b8d42571 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:28.455102 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1abf3b8-cf25-403d-9730-bbf6b8d42571 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:28.456579 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1abf3b8-cf25-403d-9730-bbf6b8d42571 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:28.458122 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 32/60] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:51:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:28.463536 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042fed44-0b9b-4b38-b793-0564588c639a None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:28.520194 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:28.558307 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042fed44-0b9b-4b38-b793-0564588c639a None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:28.590578 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be4372-cf7f-4dad-bbd6-0ff2c06b2983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:28.591191 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be4372-cf7f-4dad-bbd6-0ff2c06b2983 None admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:28.591467 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be4372-cf7f-4dad-bbd6-0ff2c06b2983 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:28.591760 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be4372-cf7f-4dad-bbd6-0ff2c06b2983 None admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:28.592442 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0be4372-cf7f-4dad-bbd6-0ff2c06b2983 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:28.593869 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0be4372-cf7f-4dad-bbd6-0ff2c06b2983 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:28.619001 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 29/61] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Jul 27 18:51:28 2022] POST /identity/v3/users => generated 275 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:51:31.583244 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992e5c6-d98b-468e-9348-9226cc9d64ab None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:31.584253 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992e5c6-d98b-468e-9348-9226cc9d64ab None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:31.584730 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992e5c6-d98b-468e-9348-9226cc9d64ab None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:31.586277 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 33/62] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:51:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:51:31.591776 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519f2b2-2d76-4940-bfe0-bf51555e093f None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:31.592584 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519f2b2-2d76-4940-bfe0-bf51555e093f None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:31.593117 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519f2b2-2d76-4940-bfe0-bf51555e093f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:31.620693 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-0519f2b2-2d76-4940-bfe0-bf51555e093f None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:51:31.622739 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-0519f2b2-2d76-4940-bfe0-bf51555e093f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:31.672328 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b9181-243f-4822-8d3e-e757e8796a2f None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:31.672973 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b9181-243f-4822-8d3e-e757e8796a2f None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:31.673455 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b9181-243f-4822-8d3e-e757e8796a2f None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:31.674994 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 34/63] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:51:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:51:31.680052 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ea424-4cd8-492d-91e1-422254e646be None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:31.680564 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ea424-4cd8-492d-91e1-422254e646be None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:31.681053 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ea424-4cd8-492d-91e1-422254e646be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:31.707410 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-619ea424-4cd8-492d-91e1-422254e646be None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:51:31.708958 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-619ea424-4cd8-492d-91e1-422254e646be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:31.744462 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 30/64] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:51:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:51:31.796125 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:31.803715 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 35/65] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:51:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:51:31.806285 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0519f2b2-2d76-4940-bfe0-bf51555e093f None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:31.836828 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ea424-4cd8-492d-91e1-422254e646be None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:31.882455 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:31.986289 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0519f2b2-2d76-4940-bfe0-bf51555e093f None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:32.016105 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ea424-4cd8-492d-91e1-422254e646be None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:32.043365 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b8747-11d7-4666-8b05-f35135cab7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:32.044048 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b8747-11d7-4666-8b05-f35135cab7df None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:32.044336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b8747-11d7-4666-8b05-f35135cab7df None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:32.044617 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b8747-11d7-4666-8b05-f35135cab7df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:32.076162 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b8747-11d7-4666-8b05-f35135cab7df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:51:32.084628 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf33e51e-8682-465b-bd5f-882555ad1094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:32.085298 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33e51e-8682-465b-bd5f-882555ad1094 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:32.085620 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33e51e-8682-465b-bd5f-882555ad1094 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:32.085900 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33e51e-8682-465b-bd5f-882555ad1094 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:32.094468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-ed9b8747-11d7-4666-8b05-f35135cab7df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:51:32.094468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:51:32.094468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:51:32.094468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:51:32.094468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:51:32.094468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:51:32.094468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:51:32.094468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:51:32.094468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:51:32.094468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:51:32.094468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:51:32.094468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:51:32.094468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:51:32.094468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:51:32.094468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:51:32.094468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:51:32.095321 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:51:32.095321 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:51:32.095321 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:51:32.095321 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:51:32.095321 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:51:32.095321 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:51:32.095321 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:51:32.095321 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:51:32.095321 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:51:32.095321 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:51:32.095321 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:51:32.095321 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:51:32.095321 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:51:32.095321 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:51:32.095321 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:51:32.095321 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:51:32.096603 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:51:32.096603 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:51:32.096603 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:51:32.096603 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:51:32.096603 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:51:32.096603 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:51:32.096603 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:51:32.096603 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:51:32.096603 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:51:32.096603 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:51:32.096603 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:51:32.096603 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:51:32.096603 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 31/66] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 27 18:51:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:51:32.105344 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b8747-11d7-4666-8b05-f35135cab7df None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:32.110919 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf33e51e-8682-465b-bd5f-882555ad1094 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:51:32.116583 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-cf33e51e-8682-465b-bd5f-882555ad1094 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:51:32.116583 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:51:32.116583 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:51:32.116583 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:51:32.116583 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:51:32.116583 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:51:32.116583 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:51:32.116583 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:51:32.116583 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:51:32.116583 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:51:32.116583 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:51:32.116583 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:51:32.116583 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:51:32.116583 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:51:32.116583 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:51:32.116583 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:51:32.117382 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:51:32.117382 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:51:32.117382 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:51:32.117382 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:51:32.117382 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:51:32.117382 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:51:32.117382 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:51:32.117382 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:51:32.117382 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:51:32.117382 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:51:32.117382 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:51:32.117382 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:51:32.117382 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:51:32.117382 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:51:32.117382 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:51:32.117382 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:51:32.118812 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:51:32.118812 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:51:32.118812 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:51:32.118812 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:51:32.118812 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:51:32.118812 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:51:32.118812 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:51:32.118812 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:51:32.118812 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:51:32.118812 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:51:32.118812 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:51:32.118812 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:51:32.118812 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 36/67] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 27 18:51:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:51:32.123797 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf33e51e-8682-465b-bd5f-882555ad1094 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:32.195967 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:32.235625 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b8747-11d7-4666-8b05-f35135cab7df None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:32.243674 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:32.247903 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf33e51e-8682-465b-bd5f-882555ad1094 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:32.274113 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a939ffa-f224-47cb-bdf7-e9aa86622070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:32.274743 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a939ffa-f224-47cb-bdf7-e9aa86622070 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:32.275032 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a939ffa-f224-47cb-bdf7-e9aa86622070 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:32.275311 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a939ffa-f224-47cb-bdf7-e9aa86622070 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:32.276067 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a939ffa-f224-47cb-bdf7-e9aa86622070 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:51:32.276377 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a939ffa-f224-47cb-bdf7-e9aa86622070 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:32.277954 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a939ffa-f224-47cb-bdf7-e9aa86622070 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:32.286142 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea510c-4015-4332-95c8-8e0d9e8c0c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:32.286394 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 32/68] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 27 18:51:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:51:32.287190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea510c-4015-4332-95c8-8e0d9e8c0c59 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:32.287526 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8f99c-45bb-4c9f-a76d-e4982724feb9 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:32.287852 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8f99c-45bb-4c9f-a76d-e4982724feb9 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:32.288137 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8f99c-45bb-4c9f-a76d-e4982724feb9 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:32.288357 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea510c-4015-4332-95c8-8e0d9e8c0c59 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:32.288823 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea510c-4015-4332-95c8-8e0d9e8c0c59 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:32.289718 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ea510c-4015-4332-95c8-8e0d9e8c0c59 None admin] RBAC: Adding query filter params (name=member) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:51:32.290207 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ea510c-4015-4332-95c8-8e0d9e8c0c59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:32.292013 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ea510c-4015-4332-95c8-8e0d9e8c0c59 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:32.293887 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 33/69] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:51:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:51:32.295015 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12cd9fe-5e7e-493a-8795-ab8f2f57ddf2 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:32.295309 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12cd9fe-5e7e-493a-8795-ab8f2f57ddf2 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:32.295592 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12cd9fe-5e7e-493a-8795-ab8f2f57ddf2 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:32.296866 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 34/70] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:51:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:51:32.297572 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12cd9fe-5e7e-493a-8795-ab8f2f57ddf2 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:32.303308 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 37/71] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 27 18:51:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:32.304865 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694de2f4-9f3c-41e7-b534-7a6aebfad32d None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:32.305225 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694de2f4-9f3c-41e7-b534-7a6aebfad32d None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:32.305571 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694de2f4-9f3c-41e7-b534-7a6aebfad32d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:32.323545 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-694de2f4-9f3c-41e7-b534-7a6aebfad32d None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:51:32.324793 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-694de2f4-9f3c-41e7-b534-7a6aebfad32d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:32.396582 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 38/72] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:51:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:51:32.397840 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209011f-7bc0-42aa-acaa-0602f9fabaa2 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:32.398132 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209011f-7bc0-42aa-acaa-0602f9fabaa2 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:32.398407 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209011f-7bc0-42aa-acaa-0602f9fabaa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:32.417376 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-3209011f-7bc0-42aa-acaa-0602f9fabaa2 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:51:32.417795 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12cd9fe-5e7e-493a-8795-ab8f2f57ddf2 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:32.419117 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-3209011f-7bc0-42aa-acaa-0602f9fabaa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:32.454002 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77dfd2c-420b-429c-b1c1-58ae1179182b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:32.454638 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77dfd2c-420b-429c-b1c1-58ae1179182b None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:32.454920 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77dfd2c-420b-429c-b1c1-58ae1179182b None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:32.455190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77dfd2c-420b-429c-b1c1-58ae1179182b None admin] PATH_INFO: `/v3/users/a75f20e26df34773ae258f20480b0b50` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:32.456376 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77dfd2c-420b-429c-b1c1-58ae1179182b None admin] RBAC: Authorizing `identity:get_user(user_id=a75f20e26df34773ae258f20480b0b50)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:32.457813 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77dfd2c-420b-429c-b1c1-58ae1179182b None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:32.459415 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 35/73] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 27 18:51:32 2022] GET /identity/v3/users/a75f20e26df34773ae258f20480b0b50 => generated 247 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:32.460198 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77dfd2c-420b-429c-b1c1-58ae1179182b None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:32.463910 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:32.493816 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 39/74] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:51:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:51:32.494946 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3209011f-7bc0-42aa-acaa-0602f9fabaa2 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:32.507391 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:32.575260 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77dfd2c-420b-429c-b1c1-58ae1179182b None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:32.608864 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c36e9-4ab3-46ed-9e36-de17d220f3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:32.609432 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3209011f-7bc0-42aa-acaa-0602f9fabaa2 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:32.609808 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c36e9-4ab3-46ed-9e36-de17d220f3aa None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:32.609808 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c36e9-4ab3-46ed-9e36-de17d220f3aa None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:32.610044 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c36e9-4ab3-46ed-9e36-de17d220f3aa None admin] PATH_INFO: `/v3/users/78ed1d1d6c8a4c3ea357e2812cecb67f` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:32.623128 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992c36e9-4ab3-46ed-9e36-de17d220f3aa None admin] RBAC: Authorizing `identity:get_user(user_id=78ed1d1d6c8a4c3ea357e2812cecb67f)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:32.624616 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992c36e9-4ab3-46ed-9e36-de17d220f3aa None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:32.626439 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 36/75] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 27 18:51:32 2022] GET /identity/v3/users/78ed1d1d6c8a4c3ea357e2812cecb67f => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:32.627006 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c36e9-4ab3-46ed-9e36-de17d220f3aa None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:32.642409 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b99341-f37a-4e79-a810-a2e4ba15f64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:32.643052 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b99341-f37a-4e79-a810-a2e4ba15f64d None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:32.643342 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b99341-f37a-4e79-a810-a2e4ba15f64d None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:32.643620 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b99341-f37a-4e79-a810-a2e4ba15f64d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:32.654314 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b99341-f37a-4e79-a810-a2e4ba15f64d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:51:32.659133 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-34b99341-f37a-4e79-a810-a2e4ba15f64d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:51:32.659133 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:51:32.659133 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:51:32.659133 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:51:32.659133 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:51:32.659133 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:51:32.659133 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:51:32.659133 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:51:32.659133 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:51:32.659133 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:51:32.659133 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:51:32.659133 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:51:32.659133 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:51:32.659133 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:51:32.659133 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:51:32.659133 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:51:32.660015 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:51:32.660015 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:51:32.660015 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:51:32.660015 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:51:32.660015 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:51:32.660015 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:51:32.660015 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:51:32.660015 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:51:32.660015 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:51:32.660015 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:51:32.660015 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:51:32.660015 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:51:32.660015 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:51:32.660015 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:51:32.660015 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:51:32.660015 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:51:32.660882 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:51:32.660882 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:51:32.660882 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:51:32.660882 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:51:32.660882 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:51:32.660882 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:51:32.660882 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:51:32.660882 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:51:32.660882 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:51:32.660882 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:51:32.660882 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:51:32.660882 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:51:32.660882 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 40/76] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 27 18:51:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:51:32.663459 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da7d33d-e481-471d-b35d-89c7e1a1fec0 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:32.663855 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da7d33d-e481-471d-b35d-89c7e1a1fec0 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:32.664141 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da7d33d-e481-471d-b35d-89c7e1a1fec0 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:32.665992 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 41/77] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:51:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:51:32.666688 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da7d33d-e481-471d-b35d-89c7e1a1fec0 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:32.701537 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:32.722580 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:32.729425 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c36e9-4ab3-46ed-9e36-de17d220f3aa None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:32.762795 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f4196-1c07-40e1-988d-2820fba47ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:32.763445 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f4196-1c07-40e1-988d-2820fba47ab5 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:32.763765 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f4196-1c07-40e1-988d-2820fba47ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:32.764048 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f4196-1c07-40e1-988d-2820fba47ab5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:32.766982 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da7d33d-e481-471d-b35d-89c7e1a1fec0 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:32.800431 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cda449-1d23-414e-8d81-6e572154b277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:32.801058 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cda449-1d23-414e-8d81-6e572154b277 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:32.801340 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cda449-1d23-414e-8d81-6e572154b277 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:32.801613 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cda449-1d23-414e-8d81-6e572154b277 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:32.811780 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cda449-1d23-414e-8d81-6e572154b277 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:51:32.816618 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-70cda449-1d23-414e-8d81-6e572154b277 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:51:32.816618 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:51:32.816618 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:51:32.816618 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:51:32.816618 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:51:32.816618 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:51:32.816618 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:51:32.816618 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:51:32.816618 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:51:32.816618 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:51:32.816618 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:51:32.816618 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:51:32.816618 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:51:32.816618 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:51:32.816618 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:51:32.816618 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:51:32.817552 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:51:32.817552 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:51:32.817552 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:51:32.817552 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:51:32.817552 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:51:32.817552 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:51:32.817552 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:51:32.817552 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:51:32.817552 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:51:32.817552 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:51:32.817552 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:51:32.817552 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:51:32.817552 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:51:32.817552 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:51:32.817552 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:51:32.817552 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:51:32.818402 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:51:32.818402 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:51:32.818402 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:51:32.818402 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:51:32.818402 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:51:32.818402 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:51:32.818402 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:51:32.818402 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:51:32.818402 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:51:32.818402 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:51:32.818402 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:51:32.818402 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:51:32.818402 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 42/78] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 27 18:51:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:51:32.823235 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cda449-1d23-414e-8d81-6e572154b277 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:32.830959 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2f4196-1c07-40e1-988d-2820fba47ab5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:32.832451 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2f4196-1c07-40e1-988d-2820fba47ab5 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:32.915307 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:32.921016 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:32.922743 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cda449-1d23-414e-8d81-6e572154b277 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:32.928079 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 37/79] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 27 18:51:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:51:32.928871 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f4196-1c07-40e1-988d-2820fba47ab5 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:32.962252 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94c1a8-e673-4489-8b52-fef86a7dd6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:32.962857 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94c1a8-e673-4489-8b52-fef86a7dd6ac None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:32.963141 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94c1a8-e673-4489-8b52-fef86a7dd6ac None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:32.963416 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94c1a8-e673-4489-8b52-fef86a7dd6ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:33.031661 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f4196-1c07-40e1-988d-2820fba47ab5 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:33.031914 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac94c1a8-e673-4489-8b52-fef86a7dd6ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:33.033389 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac94c1a8-e673-4489-8b52-fef86a7dd6ac None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:33.064723 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51edc62-b04c-4215-a7bd-d23005d0eb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:33.065330 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51edc62-b04c-4215-a7bd-d23005d0eb86 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:33.065610 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51edc62-b04c-4215-a7bd-d23005d0eb86 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:33.065880 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51edc62-b04c-4215-a7bd-d23005d0eb86 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:33.066594 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51edc62-b04c-4215-a7bd-d23005d0eb86 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:51:33.066896 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51edc62-b04c-4215-a7bd-d23005d0eb86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:33.068292 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51edc62-b04c-4215-a7bd-d23005d0eb86 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:33.076543 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 38/80] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 27 18:51:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:33.080947 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788e17d-e89f-4e8f-bd05-11d69fa897d9 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:33.081245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788e17d-e89f-4e8f-bd05-11d69fa897d9 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:33.081524 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788e17d-e89f-4e8f-bd05-11d69fa897d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:33.098130 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-d788e17d-e89f-4e8f-bd05-11d69fa897d9 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:51:33.099289 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-d788e17d-e89f-4e8f-bd05-11d69fa897d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:33.124255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:33.132137 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 43/81] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 27 18:51:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:51:33.132137 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94c1a8-e673-4489-8b52-fef86a7dd6ac None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:33.154633 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:33.171318 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 39/82] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:51:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:51:33.172116 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788e17d-e89f-4e8f-bd05-11d69fa897d9 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:33.234506 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94c1a8-e673-4489-8b52-fef86a7dd6ac None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:33.268145 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a5965d-0e57-4e52-86e9-61a5d15312a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:33.268768 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5965d-0e57-4e52-86e9-61a5d15312a0 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:33.269056 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5965d-0e57-4e52-86e9-61a5d15312a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:33.269335 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5965d-0e57-4e52-86e9-61a5d15312a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:33.269503 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788e17d-e89f-4e8f-bd05-11d69fa897d9 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:33.270051 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a5965d-0e57-4e52-86e9-61a5d15312a0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:51:33.270359 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a5965d-0e57-4e52-86e9-61a5d15312a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:33.271750 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a5965d-0e57-4e52-86e9-61a5d15312a0 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:33.279773 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 44/83] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 27 18:51:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:33.280598 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a5965d-0e57-4e52-86e9-61a5d15312a0 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:33.301868 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8686df7-849e-439e-8106-d956fdca9542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:33.302510 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8686df7-849e-439e-8106-d956fdca9542 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:33.302794 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8686df7-849e-439e-8106-d956fdca9542 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:33.303070 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8686df7-849e-439e-8106-d956fdca9542 None admin] PATH_INFO: `/v3/projects/d85bb1f7e9394d898e25c565c5043262` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:33.304248 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8686df7-849e-439e-8106-d956fdca9542 None admin] RBAC: Authorizing `identity:get_project(project_id=d85bb1f7e9394d898e25c565c5043262)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:33.305689 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8686df7-849e-439e-8106-d956fdca9542 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:33.307343 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 40/84] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 27 18:51:33 2022] GET /identity/v3/projects/d85bb1f7e9394d898e25c565c5043262 => generated 298 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:33.308106 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8686df7-849e-439e-8106-d956fdca9542 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:33.335194 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:33.363525 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:33.379967 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a5965d-0e57-4e52-86e9-61a5d15312a0 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:33.411938 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8686df7-849e-439e-8106-d956fdca9542 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:33.421814 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18748ea3-2a92-4427-9312-119283c8f8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:33.422385 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18748ea3-2a92-4427-9312-119283c8f8bc None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:33.422677 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18748ea3-2a92-4427-9312-119283c8f8bc None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:33.422951 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18748ea3-2a92-4427-9312-119283c8f8bc None admin] PATH_INFO: `/v3/users/78ed1d1d6c8a4c3ea357e2812cecb67f` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:33.424185 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18748ea3-2a92-4427-9312-119283c8f8bc None admin] RBAC: Authorizing `identity:get_user(user_id=78ed1d1d6c8a4c3ea357e2812cecb67f)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:33.425634 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18748ea3-2a92-4427-9312-119283c8f8bc None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:33.427392 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 45/85] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 27 18:51:33 2022] GET /identity/v3/users/78ed1d1d6c8a4c3ea357e2812cecb67f => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:33.428006 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18748ea3-2a92-4427-9312-119283c8f8bc None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:33.450712 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5721db8-7c8b-4e64-9c18-c976ac86524e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:33.451345 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5721db8-7c8b-4e64-9c18-c976ac86524e None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:33.451626 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5721db8-7c8b-4e64-9c18-c976ac86524e None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:33.451946 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5721db8-7c8b-4e64-9c18-c976ac86524e None admin] PATH_INFO: `/v3/projects/d85bb1f7e9394d898e25c565c5043262` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:33.453096 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5721db8-7c8b-4e64-9c18-c976ac86524e None admin] RBAC: Authorizing `identity:get_project(project_id=d85bb1f7e9394d898e25c565c5043262)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:33.454534 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5721db8-7c8b-4e64-9c18-c976ac86524e None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:33.456218 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 41/86] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 27 18:51:33 2022] GET /identity/v3/projects/d85bb1f7e9394d898e25c565c5043262 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:33.456965 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5721db8-7c8b-4e64-9c18-c976ac86524e None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:33.532890 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18748ea3-2a92-4427-9312-119283c8f8bc None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:33.553373 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5721db8-7c8b-4e64-9c18-c976ac86524e None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:33.555702 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:33.566879 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ca9f8-ef62-48bd-8dd8-2ac59106591f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:33.567526 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ca9f8-ef62-48bd-8dd8-2ac59106591f None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:33.567845 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ca9f8-ef62-48bd-8dd8-2ac59106591f None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:33.568127 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ca9f8-ef62-48bd-8dd8-2ac59106591f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:33.569285 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0ca9f8-ef62-48bd-8dd8-2ac59106591f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:33.570742 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0ca9f8-ef62-48bd-8dd8-2ac59106591f None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:33.572541 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 46/87] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:51:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:33.573107 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ca9f8-ef62-48bd-8dd8-2ac59106591f None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:33.580370 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:33.592525 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab37bb4-bbdc-4446-8202-f42485127ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:33.593166 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab37bb4-bbdc-4446-8202-f42485127ab2 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:33.593451 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab37bb4-bbdc-4446-8202-f42485127ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:33.593731 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab37bb4-bbdc-4446-8202-f42485127ab2 None admin] PATH_INFO: `/v3/users/78ed1d1d6c8a4c3ea357e2812cecb67f` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:33.594900 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab37bb4-bbdc-4446-8202-f42485127ab2 None admin] RBAC: Authorizing `identity:get_user(user_id=78ed1d1d6c8a4c3ea357e2812cecb67f)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:33.596379 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab37bb4-bbdc-4446-8202-f42485127ab2 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:33.597983 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 42/88] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 27 18:51:33 2022] GET /identity/v3/users/78ed1d1d6c8a4c3ea357e2812cecb67f => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:33.598742 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab37bb4-bbdc-4446-8202-f42485127ab2 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:33.681954 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ca9f8-ef62-48bd-8dd8-2ac59106591f None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:33.695707 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab37bb4-bbdc-4446-8202-f42485127ab2 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:33.715657 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebebaa2-7ea9-42b4-baf8-cc51c4bd9085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:33.716303 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebebaa2-7ea9-42b4-baf8-cc51c4bd9085 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:33.716587 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebebaa2-7ea9-42b4-baf8-cc51c4bd9085 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:33.716893 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebebaa2-7ea9-42b4-baf8-cc51c4bd9085 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:33.717679 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebebaa2-7ea9-42b4-baf8-cc51c4bd9085 None admin] RBAC: Adding query filter params (role.id=0f4a39b061e148418413cfe647af9a34, scope.project.id=d85bb1f7e9394d898e25c565c5043262, user.id=a75f20e26df34773ae258f20480b0b50) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:51:33.718001 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebebaa2-7ea9-42b4-baf8-cc51c4bd9085 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:33.719432 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebebaa2-7ea9-42b4-baf8-cc51c4bd9085 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:33.727158 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 47/89] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 27 18:51:33 2022] GET /identity/v3/role_assignments?user.id=a75f20e26df34773ae258f20480b0b50&scope.project.id=d85bb1f7e9394d898e25c565c5043262&role.id=0f4a39b061e148418413cfe647af9a34 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:33.727797 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebebaa2-7ea9-42b4-baf8-cc51c4bd9085 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:33.728482 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951cb517-a46d-420e-9e96-9a907792af41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:33.729107 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951cb517-a46d-420e-9e96-9a907792af41 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:33.729394 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951cb517-a46d-420e-9e96-9a907792af41 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:33.729671 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951cb517-a46d-420e-9e96-9a907792af41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:33.798502 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:33.802616 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:33.810325 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951cb517-a46d-420e-9e96-9a907792af41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:33.811994 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951cb517-a46d-420e-9e96-9a907792af41 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:33.857019 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebebaa2-7ea9-42b4-baf8-cc51c4bd9085 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:33.895419 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3633a7c5-1bc4-4b55-963c-41d664d5fa44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:33.896100 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3633a7c5-1bc4-4b55-963c-41d664d5fa44 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:33.896386 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3633a7c5-1bc4-4b55-963c-41d664d5fa44 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:33.896666 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3633a7c5-1bc4-4b55-963c-41d664d5fa44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:33.897467 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3633a7c5-1bc4-4b55-963c-41d664d5fa44 None admin] RBAC: Adding query filter params (role.id=448ae448fe9a474ab1166ca18f7ac4d8, scope.project.id=d85bb1f7e9394d898e25c565c5043262, user.id=78ed1d1d6c8a4c3ea357e2812cecb67f) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:51:33.897783 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3633a7c5-1bc4-4b55-963c-41d664d5fa44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:33.899218 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3633a7c5-1bc4-4b55-963c-41d664d5fa44 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:33.905760 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 48/90] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 27 18:51:33 2022] GET /identity/v3/role_assignments?user.id=78ed1d1d6c8a4c3ea357e2812cecb67f&scope.project.id=d85bb1f7e9394d898e25c565c5043262&role.id=448ae448fe9a474ab1166ca18f7ac4d8 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:33.906359 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3633a7c5-1bc4-4b55-963c-41d664d5fa44 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:33.940617 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 43/91] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 27 18:51:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:51:33.942499 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951cb517-a46d-420e-9e96-9a907792af41 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:34.023006 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3633a7c5-1bc4-4b55-963c-41d664d5fa44 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:34.049189 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:34.069006 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b318afa-55fc-41fa-8bed-3faa7dbbf494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:34.069729 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b318afa-55fc-41fa-8bed-3faa7dbbf494 None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:34.070023 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b318afa-55fc-41fa-8bed-3faa7dbbf494 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:34.070302 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b318afa-55fc-41fa-8bed-3faa7dbbf494 None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:34.070997 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b318afa-55fc-41fa-8bed-3faa7dbbf494 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:34.072469 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b318afa-55fc-41fa-8bed-3faa7dbbf494 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:34.093357 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:34.097998 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951cb517-a46d-420e-9e96-9a907792af41 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:34.104935 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 49/92] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Jul 27 18:51:33 2022] POST /identity/v3/users => generated 289 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:51:34.106137 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b318afa-55fc-41fa-8bed-3faa7dbbf494 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:34.147915 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61701e72-2875-44b6-946c-6dd78ddeb517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:34.148850 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61701e72-2875-44b6-946c-6dd78ddeb517 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:34.149238 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61701e72-2875-44b6-946c-6dd78ddeb517 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:34.149612 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61701e72-2875-44b6-946c-6dd78ddeb517 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:34.247582 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61701e72-2875-44b6-946c-6dd78ddeb517 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:34.249039 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61701e72-2875-44b6-946c-6dd78ddeb517 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:34.317535 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b318afa-55fc-41fa-8bed-3faa7dbbf494 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:34.364808 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce7529-cda2-44e3-82e5-fb3d1ac382c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:34.365462 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce7529-cda2-44e3-82e5-fb3d1ac382c1 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:34.365748 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce7529-cda2-44e3-82e5-fb3d1ac382c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:34.366028 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce7529-cda2-44e3-82e5-fb3d1ac382c1 None admin] PATH_INFO: `/v3/projects/d85bb1f7e9394d898e25c565c5043262` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:34.367278 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ce7529-cda2-44e3-82e5-fb3d1ac382c1 None admin] RBAC: Authorizing `identity:get_project(project_id=d85bb1f7e9394d898e25c565c5043262)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:34.370555 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ce7529-cda2-44e3-82e5-fb3d1ac382c1 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:34.373472 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 50/93] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 27 18:51:34 2022] GET /identity/v3/projects/d85bb1f7e9394d898e25c565c5043262 => generated 298 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:34.379170 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce7529-cda2-44e3-82e5-fb3d1ac382c1 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:34.391138 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:34.406787 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 44/94] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 27 18:51:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:51:34.413819 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61701e72-2875-44b6-946c-6dd78ddeb517 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:34.442591 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:34.523187 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce7529-cda2-44e3-82e5-fb3d1ac382c1 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:34.562649 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61701e72-2875-44b6-946c-6dd78ddeb517 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:34.571585 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de184643-30bf-453d-bd80-c0deef6a4412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:34.572260 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de184643-30bf-453d-bd80-c0deef6a4412 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:34.572548 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de184643-30bf-453d-bd80-c0deef6a4412 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:34.572827 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de184643-30bf-453d-bd80-c0deef6a4412 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:34.574104 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de184643-30bf-453d-bd80-c0deef6a4412 None admin] RBAC: Adding query filter params (role.id=8d808722e03a4591a59440f170ec672f, scope.project.id=d85bb1f7e9394d898e25c565c5043262, user.id=78ed1d1d6c8a4c3ea357e2812cecb67f) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:51:34.574987 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de184643-30bf-453d-bd80-c0deef6a4412 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:34.576898 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de184643-30bf-453d-bd80-c0deef6a4412 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:34.585221 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 51/95] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 27 18:51:34 2022] GET /identity/v3/role_assignments?user.id=78ed1d1d6c8a4c3ea357e2812cecb67f&scope.project.id=d85bb1f7e9394d898e25c565c5043262&role.id=8d808722e03a4591a59440f170ec672f => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:34.614422 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f951b202-1feb-479e-9973-9bbd2431d9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:34.615100 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951b202-1feb-479e-9973-9bbd2431d9a8 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:34.615392 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951b202-1feb-479e-9973-9bbd2431d9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:34.615678 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951b202-1feb-479e-9973-9bbd2431d9a8 None admin] PATH_INFO: `/v3/projects/b7237ee3a0e64d3280478e6e61059e9f` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:34.616965 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f951b202-1feb-479e-9973-9bbd2431d9a8 None admin] RBAC: Authorizing `identity:get_project(project_id=b7237ee3a0e64d3280478e6e61059e9f)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:34.619814 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f951b202-1feb-479e-9973-9bbd2431d9a8 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:34.622154 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 45/96] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 27 18:51:34 2022] GET /identity/v3/projects/b7237ee3a0e64d3280478e6e61059e9f => generated 312 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:34.628505 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de184643-30bf-453d-bd80-c0deef6a4412 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:34.760179 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de184643-30bf-453d-bd80-c0deef6a4412 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:34.771102 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:34.798634 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf26fbe4-ea19-4418-9131-a6f9e88abbd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:34.799234 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26fbe4-ea19-4418-9131-a6f9e88abbd9 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:34.799517 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26fbe4-ea19-4418-9131-a6f9e88abbd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:34.799860 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26fbe4-ea19-4418-9131-a6f9e88abbd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:34.800658 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf26fbe4-ea19-4418-9131-a6f9e88abbd9 None admin] RBAC: Adding query filter params (role.id=448ae448fe9a474ab1166ca18f7ac4d8, scope.project.id=b7237ee3a0e64d3280478e6e61059e9f, user.id=78ed1d1d6c8a4c3ea357e2812cecb67f) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:51:34.800970 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf26fbe4-ea19-4418-9131-a6f9e88abbd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:34.802418 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf26fbe4-ea19-4418-9131-a6f9e88abbd9 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:34.808427 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 52/97] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 27 18:51:34 2022] GET /identity/v3/role_assignments?user.id=78ed1d1d6c8a4c3ea357e2812cecb67f&scope.project.id=b7237ee3a0e64d3280478e6e61059e9f&role.id=448ae448fe9a474ab1166ca18f7ac4d8 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:36.333486 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc08752-7bb4-48aa-ae88-df2385e7a83a None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:36.334025 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc08752-7bb4-48aa-ae88-df2385e7a83a None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:36.334101 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc08752-7bb4-48aa-ae88-df2385e7a83a None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:36.335727 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 46/98] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:51:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:51:36.341544 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f34dd-fea7-4abb-b8e4-132129c15d0f None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:36.341936 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f34dd-fea7-4abb-b8e4-132129c15d0f None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:36.342116 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f34dd-fea7-4abb-b8e4-132129c15d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:36.365817 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-353f34dd-fea7-4abb-b8e4-132129c15d0f None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:51:36.367017 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-353f34dd-fea7-4abb-b8e4-132129c15d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:36.453712 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 53/99] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:51:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:51:36.488585 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc08752-7bb4-48aa-ae88-df2385e7a83a None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:36.562788 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:36.616444 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc08752-7bb4-48aa-ae88-df2385e7a83a None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:36.660119 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba4d86-9884-4b1a-a78a-c9126f962d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:36.660769 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba4d86-9884-4b1a-a78a-c9126f962d95 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:36.661051 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba4d86-9884-4b1a-a78a-c9126f962d95 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:36.661324 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba4d86-9884-4b1a-a78a-c9126f962d95 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:36.676376 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bba4d86-9884-4b1a-a78a-c9126f962d95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:51:36.681294 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-8bba4d86-9884-4b1a-a78a-c9126f962d95 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:51:36.681294 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:51:36.681294 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:51:36.681294 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:51:36.681294 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:51:36.681294 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:51:36.681294 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:51:36.681294 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:51:36.681294 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:51:36.681294 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:51:36.681294 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:51:36.681294 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:51:36.681294 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:51:36.681294 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:51:36.681294 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:51:36.681294 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:51:36.682129 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:51:36.682129 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:51:36.682129 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:51:36.682129 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:51:36.682129 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:51:36.682129 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:51:36.682129 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:51:36.682129 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:51:36.682129 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:51:36.682129 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:51:36.682129 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:51:36.682129 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:51:36.682129 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:51:36.682129 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:51:36.682129 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:51:36.682129 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:51:36.682897 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:51:36.682897 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:51:36.682897 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:51:36.682897 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:51:36.682897 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:51:36.682897 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:51:36.682897 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:51:36.682897 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:51:36.682897 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:51:36.682897 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:51:36.682897 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:51:36.682897 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:51:36.682897 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 47/100] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 27 18:51:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:51:36.690064 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f34dd-fea7-4abb-b8e4-132129c15d0f None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:36.828080 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f34dd-fea7-4abb-b8e4-132129c15d0f None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:36.829606 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:36.877841 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615265d0-8d36-4027-ac6d-6cac961539b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:36.878388 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615265d0-8d36-4027-ac6d-6cac961539b3 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:36.878669 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615265d0-8d36-4027-ac6d-6cac961539b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:36.878941 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615265d0-8d36-4027-ac6d-6cac961539b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:36.879660 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615265d0-8d36-4027-ac6d-6cac961539b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:51:36.879990 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615265d0-8d36-4027-ac6d-6cac961539b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:36.881352 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615265d0-8d36-4027-ac6d-6cac961539b3 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:36.895264 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 54/101] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 27 18:51:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:36.901123 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba4d86-9884-4b1a-a78a-c9126f962d95 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:37.013208 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068eb21c-63b4-4ff5-aa36-d532d5ece026 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:37.013520 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068eb21c-63b4-4ff5-aa36-d532d5ece026 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:37.013763 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068eb21c-63b4-4ff5-aa36-d532d5ece026 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:37.015097 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 55/102] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:51:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:51:37.020862 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18e2f3-1069-49d9-ae6b-b6578eec4727 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:37.021145 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18e2f3-1069-49d9-ae6b-b6578eec4727 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:37.021418 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18e2f3-1069-49d9-ae6b-b6578eec4727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:37.039785 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba4d86-9884-4b1a-a78a-c9126f962d95 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:37.063564 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-2c18e2f3-1069-49d9-ae6b-b6578eec4727 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:51:37.064771 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-2c18e2f3-1069-49d9-ae6b-b6578eec4727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:37.067052 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:37.082567 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c862c-73e0-441f-b98e-ac1cf66b2f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:37.083225 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c862c-73e0-441f-b98e-ac1cf66b2f18 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:37.083508 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c862c-73e0-441f-b98e-ac1cf66b2f18 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:37.083819 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c862c-73e0-441f-b98e-ac1cf66b2f18 None admin] PATH_INFO: `/v3/users/a75f20e26df34773ae258f20480b0b50` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:37.085015 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676c862c-73e0-441f-b98e-ac1cf66b2f18 None admin] RBAC: Authorizing `identity:get_user(user_id=a75f20e26df34773ae258f20480b0b50)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:37.087002 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676c862c-73e0-441f-b98e-ac1cf66b2f18 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:37.094517 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 48/103] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 27 18:51:36 2022] GET /identity/v3/users/a75f20e26df34773ae258f20480b0b50 => generated 247 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:37.100156 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c862c-73e0-441f-b98e-ac1cf66b2f18 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:37.214117 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 56/104] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:51:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:51:37.233982 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0e8ef-b9fc-4ac8-9b2b-fccef6d47521 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:37.234299 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0e8ef-b9fc-4ac8-9b2b-fccef6d47521 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:37.234535 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0e8ef-b9fc-4ac8-9b2b-fccef6d47521 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:37.236050 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 57/105] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:51:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:51:37.244956 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57207c4-2dd5-4fcf-978d-ae25dc036cfb None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:37.245244 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57207c4-2dd5-4fcf-978d-ae25dc036cfb None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:37.245526 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57207c4-2dd5-4fcf-978d-ae25dc036cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:37.284714 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-f57207c4-2dd5-4fcf-978d-ae25dc036cfb None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:51:37.285915 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-f57207c4-2dd5-4fcf-978d-ae25dc036cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:37.329181 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c862c-73e0-441f-b98e-ac1cf66b2f18 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:37.353058 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 58/106] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:51:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:51:37.353805 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57207c4-2dd5-4fcf-978d-ae25dc036cfb None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:37.385053 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:37.420597 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5081ba-6468-4cb9-b674-89e739279438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:37.422067 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5081ba-6468-4cb9-b674-89e739279438 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:37.422553 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5081ba-6468-4cb9-b674-89e739279438 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:37.423025 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5081ba-6468-4cb9-b674-89e739279438 None admin] PATH_INFO: `/v3/projects/d85bb1f7e9394d898e25c565c5043262` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:37.428496 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5081ba-6468-4cb9-b674-89e739279438 None admin] RBAC: Authorizing `identity:get_project(project_id=d85bb1f7e9394d898e25c565c5043262)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:37.430437 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5081ba-6468-4cb9-b674-89e739279438 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:37.432729 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 49/107] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 27 18:51:37 2022] GET /identity/v3/projects/d85bb1f7e9394d898e25c565c5043262 => generated 298 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:37.433784 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5081ba-6468-4cb9-b674-89e739279438 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:37.455393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57207c4-2dd5-4fcf-978d-ae25dc036cfb None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:37.490119 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d08ffc-c36e-4a33-9413-75806caed8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:37.490681 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d08ffc-c36e-4a33-9413-75806caed8fe None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:37.490963 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d08ffc-c36e-4a33-9413-75806caed8fe None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:37.491234 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d08ffc-c36e-4a33-9413-75806caed8fe None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:37.517237 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d08ffc-c36e-4a33-9413-75806caed8fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:51:37.527810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-72d08ffc-c36e-4a33-9413-75806caed8fe None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 18:51:37.527810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:51:37.527810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:51:37.527810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:51:37.527810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:51:37.527810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:51:37.527810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:51:37.527810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:51:37.527810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:51:37.527810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:51:37.527810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:51:37.527810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:51:37.527810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:51:37.527810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:51:37.527810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:51:37.527810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:51:37.528714 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:51:37.528714 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:51:37.528714 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:51:37.528714 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:51:37.528714 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:51:37.528714 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:51:37.528714 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:51:37.528714 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:51:37.528714 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:51:37.528714 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:51:37.528714 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:51:37.528714 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:51:37.528714 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:51:37.528714 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:51:37.528714 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:51:37.528714 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:51:37.529509 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:51:37.529509 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:51:37.529509 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:51:37.529509 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:51:37.529509 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:51:37.529509 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:51:37.529509 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:51:37.529509 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:51:37.529509 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:51:37.529509 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:51:37.529509 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 18:51:37.529509 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:51:37.529509 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 59/108] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 27 18:51:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:51:37.529509 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d08ffc-c36e-4a33-9413-75806caed8fe None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:37.541151 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:37.599049 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5081ba-6468-4cb9-b674-89e739279438 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:37.618405 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:37.634434 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d672475-e3ff-4125-af96-14cdfba5bcfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:37.635078 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d672475-e3ff-4125-af96-14cdfba5bcfb None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:37.635361 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d672475-e3ff-4125-af96-14cdfba5bcfb None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:37.635638 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d672475-e3ff-4125-af96-14cdfba5bcfb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:37.635864 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d08ffc-c36e-4a33-9413-75806caed8fe None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:37.646560 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d672475-e3ff-4125-af96-14cdfba5bcfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:51:37.651445 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-8d672475-e3ff-4125-af96-14cdfba5bcfb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:51:37.651445 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:51:37.651445 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:51:37.651445 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:51:37.651445 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:51:37.651445 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:51:37.651445 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:51:37.651445 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:51:37.651445 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:51:37.651445 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:51:37.651445 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:51:37.651445 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:51:37.651445 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:51:37.651445 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:51:37.651445 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:51:37.651445 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:51:37.652893 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:51:37.652893 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:51:37.652893 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:51:37.652893 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:51:37.652893 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:51:37.652893 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:51:37.652893 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:51:37.652893 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:51:37.652893 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:51:37.652893 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:51:37.652893 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:51:37.652893 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:51:37.652893 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:51:37.652893 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:51:37.652893 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:51:37.652893 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:51:37.654714 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:51:37.654714 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:51:37.654714 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:51:37.654714 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:51:37.654714 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:51:37.654714 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:51:37.654714 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:51:37.654714 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:51:37.654714 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:51:37.654714 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:51:37.654714 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:51:37.654714 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:51:37.654714 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 50/109] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 27 18:51:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:51:37.658821 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d672475-e3ff-4125-af96-14cdfba5bcfb None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:37.679835 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea989e-055c-471c-81da-a4f65e20eb23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:37.681176 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea989e-055c-471c-81da-a4f65e20eb23 None admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:37.681514 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea989e-055c-471c-81da-a4f65e20eb23 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:37.681957 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea989e-055c-471c-81da-a4f65e20eb23 None admin] PATH_INFO: `/v3/projects/d85bb1f7e9394d898e25c565c5043262/users/a75f20e26df34773ae258f20480b0b50/roles/0f4a39b061e148418413cfe647af9a34` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:37.684718 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aea989e-055c-471c-81da-a4f65e20eb23 None admin] RBAC: Authorizing `identity:create_grant(project_id=d85bb1f7e9394d898e25c565c5043262, user_id=a75f20e26df34773ae258f20480b0b50, role_id=0f4a39b061e148418413cfe647af9a34)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:37.686619 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aea989e-055c-471c-81da-a4f65e20eb23 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:37.701663 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 60/110] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 27 18:51:37 2022] PUT /identity/v3/projects/d85bb1f7e9394d898e25c565c5043262/users/a75f20e26df34773ae258f20480b0b50/roles/0f4a39b061e148418413cfe647af9a34 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:51:37.702912 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5546ad38-73e7-45dd-8e1d-35e9d480853c None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:37.703521 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5546ad38-73e7-45dd-8e1d-35e9d480853c None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:37.703832 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5546ad38-73e7-45dd-8e1d-35e9d480853c None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:37.705426 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 61/111] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:51:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:51:37.706390 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892dbe50-dc20-45e3-a75f-2a092503e3ed None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:37.706649 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892dbe50-dc20-45e3-a75f-2a092503e3ed None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:37.707216 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892dbe50-dc20-45e3-a75f-2a092503e3ed None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:37.714335 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 62/112] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:51:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:51:37.714335 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892dbe50-dc20-45e3-a75f-2a092503e3ed None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:37.778892 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d672475-e3ff-4125-af96-14cdfba5bcfb None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:37.795809 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:37.827795 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e4606-87c5-47c5-b0d5-cc3befa19de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:37.829371 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e4606-87c5-47c5-b0d5-cc3befa19de2 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:37.829813 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e4606-87c5-47c5-b0d5-cc3befa19de2 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:37.830234 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e4606-87c5-47c5-b0d5-cc3befa19de2 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:37.831594 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406e4606-87c5-47c5-b0d5-cc3befa19de2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:51:37.832125 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406e4606-87c5-47c5-b0d5-cc3befa19de2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:37.834410 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406e4606-87c5-47c5-b0d5-cc3befa19de2 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:37.847745 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 51/113] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 27 18:51:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:37.849532 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe368eb5-e5df-4028-819d-26e3d8fcbb83 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:37.850191 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe368eb5-e5df-4028-819d-26e3d8fcbb83 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:37.851053 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe368eb5-e5df-4028-819d-26e3d8fcbb83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:37.858441 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892dbe50-dc20-45e3-a75f-2a092503e3ed None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:37.876095 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-fe368eb5-e5df-4028-819d-26e3d8fcbb83 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:51:37.878290 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-fe368eb5-e5df-4028-819d-26e3d8fcbb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:37.908058 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d10e9-6d41-415e-a892-c5907f226eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:37.908717 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d10e9-6d41-415e-a892-c5907f226eb2 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:37.909009 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d10e9-6d41-415e-a892-c5907f226eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:37.909296 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d10e9-6d41-415e-a892-c5907f226eb2 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:37.910021 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41d10e9-6d41-415e-a892-c5907f226eb2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:51:37.910330 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41d10e9-6d41-415e-a892-c5907f226eb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:37.912573 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41d10e9-6d41-415e-a892-c5907f226eb2 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:37.921426 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 63/114] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 27 18:51:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:37.922651 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6c222-3b18-415d-b583-330d2392f865 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:37.922942 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6c222-3b18-415d-b583-330d2392f865 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:37.923216 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6c222-3b18-415d-b583-330d2392f865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:37.943943 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:37.947371 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-b4c6c222-3b18-415d-b583-330d2392f865 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:51:37.948681 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-b4c6c222-3b18-415d-b583-330d2392f865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:37.963499 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 52/115] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:51:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:51:37.964934 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe368eb5-e5df-4028-819d-26e3d8fcbb83 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:38.022291 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 64/116] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:51:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:51:38.028595 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c6c222-3b18-415d-b583-330d2392f865 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:38.085017 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe368eb5-e5df-4028-819d-26e3d8fcbb83 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:38.095237 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:38.124393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d64414-9b20-4f7c-9fa4-fa58aa0c4b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:38.125041 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d64414-9b20-4f7c-9fa4-fa58aa0c4b0d None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:38.125324 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d64414-9b20-4f7c-9fa4-fa58aa0c4b0d None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:38.125597 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d64414-9b20-4f7c-9fa4-fa58aa0c4b0d None admin] PATH_INFO: `/v3/users/b6d9213375084a0da9c98667e897f8a3` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:38.140406 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d64414-9b20-4f7c-9fa4-fa58aa0c4b0d None admin] RBAC: Authorizing `identity:get_user(user_id=b6d9213375084a0da9c98667e897f8a3)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:38.141972 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d64414-9b20-4f7c-9fa4-fa58aa0c4b0d None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:38.144003 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 53/117] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 27 18:51:37 2022] GET /identity/v3/users/b6d9213375084a0da9c98667e897f8a3 => generated 289 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:38.144622 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d64414-9b20-4f7c-9fa4-fa58aa0c4b0d None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:38.154132 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c6c222-3b18-415d-b583-330d2392f865 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:38.192283 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb27d46-4351-4e78-a444-76cc82df341f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:38.193219 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb27d46-4351-4e78-a444-76cc82df341f None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:38.193814 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb27d46-4351-4e78-a444-76cc82df341f None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:38.194264 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb27d46-4351-4e78-a444-76cc82df341f None admin] PATH_INFO: `/v3/users/78ed1d1d6c8a4c3ea357e2812cecb67f` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:38.195740 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb27d46-4351-4e78-a444-76cc82df341f None admin] RBAC: Authorizing `identity:get_user(user_id=78ed1d1d6c8a4c3ea357e2812cecb67f)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:38.197401 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb27d46-4351-4e78-a444-76cc82df341f None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:38.204580 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 65/118] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 27 18:51:38 2022] GET /identity/v3/users/78ed1d1d6c8a4c3ea357e2812cecb67f => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:38.205776 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb27d46-4351-4e78-a444-76cc82df341f None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:38.210250 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:38.256164 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d64414-9b20-4f7c-9fa4-fa58aa0c4b0d None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:38.292105 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec6ce6-ff20-4a77-95af-d7418eed45c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:38.292779 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec6ce6-ff20-4a77-95af-d7418eed45c9 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:38.293063 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec6ce6-ff20-4a77-95af-d7418eed45c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:38.293340 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec6ce6-ff20-4a77-95af-d7418eed45c9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:38.303493 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eec6ce6-ff20-4a77-95af-d7418eed45c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:51:38.309028 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-3eec6ce6-ff20-4a77-95af-d7418eed45c9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:51:38.309028 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:51:38.309028 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:51:38.309028 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:51:38.309028 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:51:38.309028 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:51:38.309028 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:51:38.309028 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:51:38.309028 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:51:38.309028 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:51:38.309028 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:51:38.309028 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:51:38.309028 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:51:38.309028 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:51:38.309028 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:51:38.309028 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:51:38.309858 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:51:38.309858 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:51:38.309858 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:51:38.309858 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:51:38.309858 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:51:38.309858 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:51:38.309858 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:51:38.309858 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:51:38.309858 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:51:38.309858 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:51:38.309858 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:51:38.309858 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:51:38.309858 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:51:38.309858 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:51:38.309858 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:51:38.309858 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:51:38.315451 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:51:38.315451 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:51:38.315451 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:51:38.315451 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:51:38.315451 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:51:38.315451 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:51:38.315451 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:51:38.315451 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:51:38.315451 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:51:38.315451 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:51:38.315451 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:51:38.315451 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:51:38.315451 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 54/119] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 27 18:51:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:51:38.315451 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec6ce6-ff20-4a77-95af-d7418eed45c9 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:38.323063 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb27d46-4351-4e78-a444-76cc82df341f None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:38.338128 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:38.358160 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6ecc0e-9ffa-4c62-a397-035f80e8ca8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:38.358806 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ecc0e-9ffa-4c62-a397-035f80e8ca8c None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:38.359086 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ecc0e-9ffa-4c62-a397-035f80e8ca8c None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:38.359363 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ecc0e-9ffa-4c62-a397-035f80e8ca8c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:38.360542 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6ecc0e-9ffa-4c62-a397-035f80e8ca8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:38.362367 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6ecc0e-9ffa-4c62-a397-035f80e8ca8c None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:38.368487 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 66/120] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:51:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:38.368487 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6ecc0e-9ffa-4c62-a397-035f80e8ca8c None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:38.426476 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec6ce6-ff20-4a77-95af-d7418eed45c9 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:38.445195 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:38.460158 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de00cb68-c575-4d7e-ba6c-48fe20eb5203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:38.460775 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00cb68-c575-4d7e-ba6c-48fe20eb5203 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:38.461058 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00cb68-c575-4d7e-ba6c-48fe20eb5203 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:38.461336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00cb68-c575-4d7e-ba6c-48fe20eb5203 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:38.478734 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6ecc0e-9ffa-4c62-a397-035f80e8ca8c None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:38.514493 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f3623-76b9-4f93-b664-5a81749a182b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:38.515448 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f3623-76b9-4f93-b664-5a81749a182b None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:38.515758 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f3623-76b9-4f93-b664-5a81749a182b None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:38.516037 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f3623-76b9-4f93-b664-5a81749a182b None admin] PATH_INFO: `/v3/projects/d85bb1f7e9394d898e25c565c5043262` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:38.517193 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139f3623-76b9-4f93-b664-5a81749a182b None admin] RBAC: Authorizing `identity:get_project(project_id=d85bb1f7e9394d898e25c565c5043262)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:38.520884 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139f3623-76b9-4f93-b664-5a81749a182b None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:38.520884 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 67/121] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 27 18:51:38 2022] GET /identity/v3/projects/d85bb1f7e9394d898e25c565c5043262 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:38.526156 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c68df-ed41-410d-92bb-fc906af9584b None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:38.526445 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c68df-ed41-410d-92bb-fc906af9584b None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:38.526724 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c68df-ed41-410d-92bb-fc906af9584b None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:38.532398 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 68/122] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:51:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:51:38.532398 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508c68df-ed41-410d-92bb-fc906af9584b None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:38.546543 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de00cb68-c575-4d7e-ba6c-48fe20eb5203 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:38.548071 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de00cb68-c575-4d7e-ba6c-48fe20eb5203 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:38.574797 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:38.632432 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508c68df-ed41-410d-92bb-fc906af9584b None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:38.661633 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 55/123] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 27 18:51:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:51:38.662474 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de00cb68-c575-4d7e-ba6c-48fe20eb5203 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:38.670952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518be285-0777-4442-98b1-e7734d52433d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:38.671586 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518be285-0777-4442-98b1-e7734d52433d None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:38.671976 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518be285-0777-4442-98b1-e7734d52433d None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:38.672252 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518be285-0777-4442-98b1-e7734d52433d None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:38.673333 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518be285-0777-4442-98b1-e7734d52433d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:51:38.673679 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518be285-0777-4442-98b1-e7734d52433d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:38.675064 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518be285-0777-4442-98b1-e7734d52433d None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:38.684022 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 69/124] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 27 18:51:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:38.684788 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518be285-0777-4442-98b1-e7734d52433d None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:38.687438 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:38.772181 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de00cb68-c575-4d7e-ba6c-48fe20eb5203 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:38.790207 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518be285-0777-4442-98b1-e7734d52433d None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:38.802713 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:38.815587 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c6b49b-f027-42ee-a784-329cb109e91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:38.816344 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6b49b-f027-42ee-a784-329cb109e91a None admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:38.816879 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6b49b-f027-42ee-a784-329cb109e91a None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:38.817049 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6b49b-f027-42ee-a784-329cb109e91a None admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:38.817746 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c6b49b-f027-42ee-a784-329cb109e91a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:38.819572 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c6b49b-f027-42ee-a784-329cb109e91a None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:38.823894 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a42d19b-a3c2-439d-9e2d-e883b3368127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:38.825073 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a42d19b-a3c2-439d-9e2d-e883b3368127 None admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:38.825362 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a42d19b-a3c2-439d-9e2d-e883b3368127 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:38.825639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a42d19b-a3c2-439d-9e2d-e883b3368127 None admin] PATH_INFO: `/v3/projects/d85bb1f7e9394d898e25c565c5043262/users/78ed1d1d6c8a4c3ea357e2812cecb67f/roles/448ae448fe9a474ab1166ca18f7ac4d8` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:38.827547 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a42d19b-a3c2-439d-9e2d-e883b3368127 None admin] RBAC: Authorizing `identity:create_grant(project_id=d85bb1f7e9394d898e25c565c5043262, user_id=78ed1d1d6c8a4c3ea357e2812cecb67f, role_id=448ae448fe9a474ab1166ca18f7ac4d8)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:38.830360 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a42d19b-a3c2-439d-9e2d-e883b3368127 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:38.844272 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 70/125] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 27 18:51:38 2022] PUT /identity/v3/projects/d85bb1f7e9394d898e25c565c5043262/users/78ed1d1d6c8a4c3ea357e2812cecb67f/roles/448ae448fe9a474ab1166ca18f7ac4d8 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:51:38.845831 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f77e0-8258-427a-8837-ebbe60951261 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:38.846131 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f77e0-8258-427a-8837-ebbe60951261 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:38.846510 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f77e0-8258-427a-8837-ebbe60951261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:38.848228 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 56/126] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Jul 27 18:51:38 2022] POST /identity/v3/projects => generated 302 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:51:38.854558 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c6b49b-f027-42ee-a784-329cb109e91a None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:38.868718 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-c07f77e0-8258-427a-8837-ebbe60951261 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:51:38.870022 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-c07f77e0-8258-427a-8837-ebbe60951261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:38.947770 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:38.975635 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 71/127] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:51:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:51:38.976955 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f77e0-8258-427a-8837-ebbe60951261 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:39.087387 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c6b49b-f027-42ee-a784-329cb109e91a None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:39.129070 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f77e0-8258-427a-8837-ebbe60951261 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:39.130360 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a733842-6ed9-4338-940c-933f462a0cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:39.131006 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a733842-6ed9-4338-940c-933f462a0cca None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:39.131291 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a733842-6ed9-4338-940c-933f462a0cca None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:39.132303 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a733842-6ed9-4338-940c-933f462a0cca None admin] PATH_INFO: `/v3/projects/d85bb1f7e9394d898e25c565c5043262` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:39.133262 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a733842-6ed9-4338-940c-933f462a0cca None admin] RBAC: Authorizing `identity:get_project(project_id=d85bb1f7e9394d898e25c565c5043262)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:39.134710 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a733842-6ed9-4338-940c-933f462a0cca None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:39.138262 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 57/128] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 27 18:51:38 2022] GET /identity/v3/projects/d85bb1f7e9394d898e25c565c5043262 => generated 298 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:39.138262 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a733842-6ed9-4338-940c-933f462a0cca None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:39.173518 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2164b-e7af-4a27-ad12-2781e2cfbfea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:39.174169 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2164b-e7af-4a27-ad12-2781e2cfbfea None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:39.174448 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2164b-e7af-4a27-ad12-2781e2cfbfea None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:39.174701 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2164b-e7af-4a27-ad12-2781e2cfbfea None admin] PATH_INFO: `/v3/users/78ed1d1d6c8a4c3ea357e2812cecb67f` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:39.176452 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd2164b-e7af-4a27-ad12-2781e2cfbfea None admin] RBAC: Authorizing `identity:get_user(user_id=78ed1d1d6c8a4c3ea357e2812cecb67f)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:39.178802 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd2164b-e7af-4a27-ad12-2781e2cfbfea None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:39.181417 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 72/129] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 27 18:51:38 2022] GET /identity/v3/users/78ed1d1d6c8a4c3ea357e2812cecb67f => generated 275 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:39.182124 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2164b-e7af-4a27-ad12-2781e2cfbfea None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:39.195514 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:39.272271 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:39.287971 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2164b-e7af-4a27-ad12-2781e2cfbfea None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:39.292105 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a733842-6ed9-4338-940c-933f462a0cca None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:39.322958 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e2ad52-92c4-43d6-a710-4ba149548d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:39.323852 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2ad52-92c4-43d6-a710-4ba149548d1e None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:39.324767 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2ad52-92c4-43d6-a710-4ba149548d1e None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:39.325115 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2ad52-92c4-43d6-a710-4ba149548d1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:39.325975 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e2ad52-92c4-43d6-a710-4ba149548d1e None admin] RBAC: Adding query filter params (role.id=7cf1c5f66b514f79bd5f95c17ac73d46, scope.project.id=d85bb1f7e9394d898e25c565c5043262, user.id=b6d9213375084a0da9c98667e897f8a3) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:51:39.326357 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e2ad52-92c4-43d6-a710-4ba149548d1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:39.328111 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e2ad52-92c4-43d6-a710-4ba149548d1e None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:39.333830 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 73/130] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 27 18:51:39 2022] GET /identity/v3/role_assignments?user.id=b6d9213375084a0da9c98667e897f8a3&scope.project.id=d85bb1f7e9394d898e25c565c5043262&role.id=7cf1c5f66b514f79bd5f95c17ac73d46 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:39.334786 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e2ad52-92c4-43d6-a710-4ba149548d1e None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:39.369490 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c25d2a3-b96c-4fa9-9add-5ee600ea90a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:39.370162 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c25d2a3-b96c-4fa9-9add-5ee600ea90a4 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:39.370446 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c25d2a3-b96c-4fa9-9add-5ee600ea90a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:39.370720 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c25d2a3-b96c-4fa9-9add-5ee600ea90a4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:39.393971 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c25d2a3-b96c-4fa9-9add-5ee600ea90a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:51:39.406656 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-0c25d2a3-b96c-4fa9-9add-5ee600ea90a4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:51:39.406656 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:51:39.406656 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:51:39.406656 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:51:39.406656 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:51:39.406656 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:51:39.406656 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:51:39.406656 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:51:39.406656 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:51:39.406656 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:51:39.406656 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:51:39.406656 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:51:39.406656 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:51:39.406656 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:51:39.406656 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:51:39.406656 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:51:39.407633 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:51:39.407633 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:51:39.407633 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:51:39.407633 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:51:39.407633 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:51:39.407633 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:51:39.407633 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:51:39.407633 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:51:39.407633 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:51:39.407633 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:51:39.407633 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:51:39.407633 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:51:39.407633 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:51:39.407633 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:51:39.407633 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:51:39.407633 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:51:39.408436 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:51:39.408436 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:51:39.408436 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:51:39.408436 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:51:39.408436 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:51:39.408436 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:51:39.408436 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:51:39.408436 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:51:39.408436 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:51:39.408436 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:51:39.408436 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:51:39.408436 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:51:39.408436 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 58/131] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 27 18:51:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:51:39.413802 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c25d2a3-b96c-4fa9-9add-5ee600ea90a4 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:39.447465 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e2ad52-92c4-43d6-a710-4ba149548d1e None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:39.484438 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded679c-522f-419e-ad21-7f312e574424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:39.485252 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded679c-522f-419e-ad21-7f312e574424 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:39.485610 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded679c-522f-419e-ad21-7f312e574424 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:39.485960 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded679c-522f-419e-ad21-7f312e574424 None admin] PATH_INFO: `/v3/projects/d85bb1f7e9394d898e25c565c5043262` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:39.487518 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ded679c-522f-419e-ad21-7f312e574424 None admin] RBAC: Authorizing `identity:get_project(project_id=d85bb1f7e9394d898e25c565c5043262)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:39.489109 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ded679c-522f-419e-ad21-7f312e574424 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:39.490915 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 74/132] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 27 18:51:39 2022] GET /identity/v3/projects/d85bb1f7e9394d898e25c565c5043262 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:39.491404 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:39.497858 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded679c-522f-419e-ad21-7f312e574424 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:39.605974 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded679c-522f-419e-ad21-7f312e574424 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:39.622815 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c25d2a3-b96c-4fa9-9add-5ee600ea90a4 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:39.628849 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:39.646088 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfe164c-b22b-4df4-9308-498d8f0c4692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:39.647116 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe164c-b22b-4df4-9308-498d8f0c4692 None admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:39.647574 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe164c-b22b-4df4-9308-498d8f0c4692 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:39.648056 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe164c-b22b-4df4-9308-498d8f0c4692 None admin] PATH_INFO: `/v3/projects/d85bb1f7e9394d898e25c565c5043262/users/78ed1d1d6c8a4c3ea357e2812cecb67f/roles/8d808722e03a4591a59440f170ec672f` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:39.650589 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfe164c-b22b-4df4-9308-498d8f0c4692 None admin] RBAC: Authorizing `identity:create_grant(project_id=d85bb1f7e9394d898e25c565c5043262, user_id=78ed1d1d6c8a4c3ea357e2812cecb67f, role_id=8d808722e03a4591a59440f170ec672f)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:39.652512 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfe164c-b22b-4df4-9308-498d8f0c4692 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:39.668233 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 75/133] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 27 18:51:39 2022] PUT /identity/v3/projects/d85bb1f7e9394d898e25c565c5043262/users/78ed1d1d6c8a4c3ea357e2812cecb67f/roles/8d808722e03a4591a59440f170ec672f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:51:39.692608 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c600a-cc76-4df7-82f8-167b39e9178e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:39.693273 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c600a-cc76-4df7-82f8-167b39e9178e None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:39.693560 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c600a-cc76-4df7-82f8-167b39e9178e None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:39.693840 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c600a-cc76-4df7-82f8-167b39e9178e None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:39.694589 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0c600a-cc76-4df7-82f8-167b39e9178e None admin] RBAC: Adding query filter params (name=member) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:51:39.694903 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0c600a-cc76-4df7-82f8-167b39e9178e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:39.696359 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0c600a-cc76-4df7-82f8-167b39e9178e None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:39.711542 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 59/134] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 27 18:51:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:51:39.717369 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfe164c-b22b-4df4-9308-498d8f0c4692 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:39.804138 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:39.865853 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfe164c-b22b-4df4-9308-498d8f0c4692 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:39.905276 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed572f75-e3a3-49e0-9d22-a2db1415d0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:39.905923 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed572f75-e3a3-49e0-9d22-a2db1415d0e6 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:39.906204 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed572f75-e3a3-49e0-9d22-a2db1415d0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:39.906472 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed572f75-e3a3-49e0-9d22-a2db1415d0e6 None admin] PATH_INFO: `/v3/users/78ed1d1d6c8a4c3ea357e2812cecb67f` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:39.907649 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed572f75-e3a3-49e0-9d22-a2db1415d0e6 None admin] RBAC: Authorizing `identity:get_user(user_id=78ed1d1d6c8a4c3ea357e2812cecb67f)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:39.909114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed572f75-e3a3-49e0-9d22-a2db1415d0e6 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:39.910695 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 76/135] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 27 18:51:39 2022] GET /identity/v3/users/78ed1d1d6c8a4c3ea357e2812cecb67f => generated 275 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:39.916452 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c600a-cc76-4df7-82f8-167b39e9178e None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:40.069195 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c600a-cc76-4df7-82f8-167b39e9178e None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:40.120944 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a5886-76a1-4904-a502-fd69b6e374bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:40.122062 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a5886-76a1-4904-a502-fd69b6e374bf None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:40.122575 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a5886-76a1-4904-a502-fd69b6e374bf None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:40.123090 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a5886-76a1-4904-a502-fd69b6e374bf None admin] PATH_INFO: `/v3/projects/b7237ee3a0e64d3280478e6e61059e9f` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:40.128421 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875a5886-76a1-4904-a502-fd69b6e374bf None admin] RBAC: Authorizing `identity:get_project(project_id=b7237ee3a0e64d3280478e6e61059e9f)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:40.130244 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875a5886-76a1-4904-a502-fd69b6e374bf None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:40.132189 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 60/136] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 27 18:51:39 2022] GET /identity/v3/projects/b7237ee3a0e64d3280478e6e61059e9f => generated 312 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:40.137908 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed572f75-e3a3-49e0-9d22-a2db1415d0e6 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:40.272946 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ff668-ba2f-4d93-b87b-54028aad2f1e None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:40.274090 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ff668-ba2f-4d93-b87b-54028aad2f1e None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:40.275065 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ff668-ba2f-4d93-b87b-54028aad2f1e None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:40.278274 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 61/137] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:51:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:51:40.283961 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed572f75-e3a3-49e0-9d22-a2db1415d0e6 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:40.286211 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88b90d-de66-4be5-b8d8-63a35f1c592b None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:40.286711 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88b90d-de66-4be5-b8d8-63a35f1c592b None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:40.287187 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88b90d-de66-4be5-b8d8-63a35f1c592b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:40.307639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-5d88b90d-de66-4be5-b8d8-63a35f1c592b None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:51:40.310860 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-5d88b90d-de66-4be5-b8d8-63a35f1c592b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:40.313365 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:40.342689 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:40.347555 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d24b2-d5c5-4808-9105-bce58820cd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:40.348491 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d24b2-d5c5-4808-9105-bce58820cd4c None admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:40.349150 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d24b2-d5c5-4808-9105-bce58820cd4c None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:40.350356 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d24b2-d5c5-4808-9105-bce58820cd4c None admin] PATH_INFO: `/v3/projects/b7237ee3a0e64d3280478e6e61059e9f/users/78ed1d1d6c8a4c3ea357e2812cecb67f/roles/448ae448fe9a474ab1166ca18f7ac4d8` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:40.353697 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55d24b2-d5c5-4808-9105-bce58820cd4c None admin] RBAC: Authorizing `identity:create_grant(project_id=b7237ee3a0e64d3280478e6e61059e9f, user_id=78ed1d1d6c8a4c3ea357e2812cecb67f, role_id=448ae448fe9a474ab1166ca18f7ac4d8)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:40.356349 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55d24b2-d5c5-4808-9105-bce58820cd4c None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:40.379763 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 77/138] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 27 18:51:40 2022] PUT /identity/v3/projects/b7237ee3a0e64d3280478e6e61059e9f/users/78ed1d1d6c8a4c3ea357e2812cecb67f/roles/448ae448fe9a474ab1166ca18f7ac4d8 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:51:40.404505 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 62/139] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:51:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:51:40.444321 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d24b2-d5c5-4808-9105-bce58820cd4c None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:40.578743 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d24b2-d5c5-4808-9105-bce58820cd4c None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:40.619005 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bafb78-860d-409c-9ad1-4339dcc59a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:40.619564 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bafb78-860d-409c-9ad1-4339dcc59a26 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:40.619865 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bafb78-860d-409c-9ad1-4339dcc59a26 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:40.620134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bafb78-860d-409c-9ad1-4339dcc59a26 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:40.632924 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bafb78-860d-409c-9ad1-4339dcc59a26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:51:40.638629 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-a3bafb78-860d-409c-9ad1-4339dcc59a26 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:51:40.638629 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:51:40.638629 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:51:40.638629 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:51:40.638629 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:51:40.638629 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:51:40.638629 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:51:40.638629 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:51:40.638629 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:51:40.638629 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:51:40.638629 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:51:40.638629 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:51:40.638629 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:51:40.638629 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:51:40.638629 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:51:40.638629 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:51:40.639465 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:51:40.639465 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:51:40.639465 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:51:40.639465 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:51:40.639465 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:51:40.639465 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:51:40.639465 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:51:40.639465 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:51:40.639465 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:51:40.639465 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:51:40.639465 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:51:40.639465 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:51:40.639465 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:51:40.639465 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:51:40.639465 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:51:40.639465 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:51:40.640239 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:51:40.640239 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:51:40.640239 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:51:40.640239 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:51:40.640239 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:51:40.640239 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:51:40.640239 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:51:40.640239 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:51:40.640239 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:51:40.640239 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:51:40.640239 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:51:40.640239 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:51:40.640239 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 78/140] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 27 18:51:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:51:40.646962 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88b90d-de66-4be5-b8d8-63a35f1c592b None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:40.757793 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88b90d-de66-4be5-b8d8-63a35f1c592b None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:40.796708 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b942c7-e2d4-4791-9c03-f81c5bab93a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:40.797331 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b942c7-e2d4-4791-9c03-f81c5bab93a4 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:40.797613 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b942c7-e2d4-4791-9c03-f81c5bab93a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:40.797931 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b942c7-e2d4-4791-9c03-f81c5bab93a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:40.798654 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b942c7-e2d4-4791-9c03-f81c5bab93a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:51:40.798955 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b942c7-e2d4-4791-9c03-f81c5bab93a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:40.800336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b942c7-e2d4-4791-9c03-f81c5bab93a4 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:40.810964 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 63/141] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 27 18:51:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:40.816529 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bafb78-860d-409c-9ad1-4339dcc59a26 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:40.863241 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:40.922719 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bafb78-860d-409c-9ad1-4339dcc59a26 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:40.957194 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7277a74b-e74d-4771-a6db-edbe76ace663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:40.957838 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277a74b-e74d-4771-a6db-edbe76ace663 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:40.958115 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277a74b-e74d-4771-a6db-edbe76ace663 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:40.958384 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277a74b-e74d-4771-a6db-edbe76ace663 None admin] PATH_INFO: `/v3/users/a75f20e26df34773ae258f20480b0b50` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:40.959550 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7277a74b-e74d-4771-a6db-edbe76ace663 None admin] RBAC: Authorizing `identity:get_user(user_id=a75f20e26df34773ae258f20480b0b50)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:40.961014 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7277a74b-e74d-4771-a6db-edbe76ace663 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:40.962766 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 79/142] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 27 18:51:40 2022] GET /identity/v3/users/a75f20e26df34773ae258f20480b0b50 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:40.968273 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b942c7-e2d4-4791-9c03-f81c5bab93a4 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:41.039766 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:41.122040 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b942c7-e2d4-4791-9c03-f81c5bab93a4 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:41.159258 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed60305-c554-4428-890c-d5c5853e8373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:41.159914 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed60305-c554-4428-890c-d5c5853e8373 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:41.160201 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed60305-c554-4428-890c-d5c5853e8373 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:41.160478 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed60305-c554-4428-890c-d5c5853e8373 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:41.250340 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed60305-c554-4428-890c-d5c5853e8373 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:41.251749 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed60305-c554-4428-890c-d5c5853e8373 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:41.293325 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:41.394166 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 64/143] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 27 18:51:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:51:41.399652 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7277a74b-e74d-4771-a6db-edbe76ace663 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:41.531526 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7277a74b-e74d-4771-a6db-edbe76ace663 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:41.541233 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:41.567895 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c080321c-3030-4f6c-87f2-5d334e9132e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:41.568223 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080321c-3030-4f6c-87f2-5d334e9132e3 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:41.568431 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080321c-3030-4f6c-87f2-5d334e9132e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:41.571719 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080321c-3030-4f6c-87f2-5d334e9132e3 None admin] PATH_INFO: `/v3/projects/d85bb1f7e9394d898e25c565c5043262` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:41.571719 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c080321c-3030-4f6c-87f2-5d334e9132e3 None admin] RBAC: Authorizing `identity:get_project(project_id=d85bb1f7e9394d898e25c565c5043262)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:41.571719 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c080321c-3030-4f6c-87f2-5d334e9132e3 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:41.573374 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 80/144] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 27 18:51:41 2022] GET /identity/v3/projects/d85bb1f7e9394d898e25c565c5043262 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:41.583717 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed60305-c554-4428-890c-d5c5853e8373 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:41.689417 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed60305-c554-4428-890c-d5c5853e8373 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:41.725983 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:41.738241 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca3bd3d-7fb6-45f7-9fd9-bb91f52f13b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:41.738876 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3bd3d-7fb6-45f7-9fd9-bb91f52f13b3 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:41.739620 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3bd3d-7fb6-45f7-9fd9-bb91f52f13b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:41.739926 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3bd3d-7fb6-45f7-9fd9-bb91f52f13b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:41.740782 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca3bd3d-7fb6-45f7-9fd9-bb91f52f13b3 None admin] RBAC: Adding query filter params (role.id=0f4a39b061e148418413cfe647af9a34, scope.project.id=d85bb1f7e9394d898e25c565c5043262, user.id=a75f20e26df34773ae258f20480b0b50) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:51:41.741100 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca3bd3d-7fb6-45f7-9fd9-bb91f52f13b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:41.742547 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca3bd3d-7fb6-45f7-9fd9-bb91f52f13b3 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:41.751021 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 65/145] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 27 18:51:41 2022] GET /identity/v3/role_assignments?user.id=a75f20e26df34773ae258f20480b0b50&scope.project.id=d85bb1f7e9394d898e25c565c5043262&role.id=0f4a39b061e148418413cfe647af9a34 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:41.897753 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708c7f7-c896-4e29-9bb2-c0059c769523 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:41.898233 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708c7f7-c896-4e29-9bb2-c0059c769523 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:41.898233 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708c7f7-c896-4e29-9bb2-c0059c769523 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:41.899714 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 81/146] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:51:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:51:41.905250 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec14584-9978-4b98-b27b-3a907eece339 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:41.905544 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec14584-9978-4b98-b27b-3a907eece339 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:41.905821 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec14584-9978-4b98-b27b-3a907eece339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:41.934037 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-7ec14584-9978-4b98-b27b-3a907eece339 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:51:41.935241 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-7ec14584-9978-4b98-b27b-3a907eece339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:42.022699 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 66/147] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:51:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:51:42.057728 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708c7f7-c896-4e29-9bb2-c0059c769523 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:42.184242 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708c7f7-c896-4e29-9bb2-c0059c769523 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:42.229939 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23935a2b-9d07-4e32-bf75-05807530b7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:42.230623 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23935a2b-9d07-4e32-bf75-05807530b7ec None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:42.230910 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23935a2b-9d07-4e32-bf75-05807530b7ec None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:42.231184 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23935a2b-9d07-4e32-bf75-05807530b7ec None admin] PATH_INFO: `/v3/domains/default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:42.233396 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d708d0b-49f7-4251-9177-3226fdc334cf None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:42.233722 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d708d0b-49f7-4251-9177-3226fdc334cf None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:42.234021 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d708d0b-49f7-4251-9177-3226fdc334cf None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:42.235655 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 67/148] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:51:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:51:42.236220 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23935a2b-9d07-4e32-bf75-05807530b7ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:42.237941 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23935a2b-9d07-4e32-bf75-05807530b7ec None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:42.239568 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 82/149] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:51:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:42.245215 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb1180-4b44-4f43-93d1-0ee941cd0cfb None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:42.245501 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb1180-4b44-4f43-93d1-0ee941cd0cfb None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:42.246322 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb1180-4b44-4f43-93d1-0ee941cd0cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:42.248874 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23935a2b-9d07-4e32-bf75-05807530b7ec None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:42.271540 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-f4fb1180-4b44-4f43-93d1-0ee941cd0cfb None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:51:42.272916 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-f4fb1180-4b44-4f43-93d1-0ee941cd0cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:42.332142 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:42.386979 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23935a2b-9d07-4e32-bf75-05807530b7ec None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:42.401687 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 68/150] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:51:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:51:42.436475 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b44886-7d0e-4511-ade1-b2e006ca8c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:42.437035 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b44886-7d0e-4511-ade1-b2e006ca8c44 None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:42.437318 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b44886-7d0e-4511-ade1-b2e006ca8c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:42.437595 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b44886-7d0e-4511-ade1-b2e006ca8c44 None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:42.438294 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b44886-7d0e-4511-ade1-b2e006ca8c44 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:42.439825 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b44886-7d0e-4511-ade1-b2e006ca8c44 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:42.446935 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb1180-4b44-4f43-93d1-0ee941cd0cfb None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:42.480903 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 83/151] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Jul 27 18:51:42 2022] POST /identity/v3/users => generated 283 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:51:42.514948 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:42.592664 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb1180-4b44-4f43-93d1-0ee941cd0cfb None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:42.639612 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4d02b6-b555-499d-96d6-0a77d1b33c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:42.640298 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d02b6-b555-499d-96d6-0a77d1b33c2a None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:42.640584 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d02b6-b555-499d-96d6-0a77d1b33c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:42.640926 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d02b6-b555-499d-96d6-0a77d1b33c2a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:42.660139 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4d02b6-b555-499d-96d6-0a77d1b33c2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:51:42.665255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-ca4d02b6-b555-499d-96d6-0a77d1b33c2a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:51:42.665255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:51:42.665255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:51:42.665255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:51:42.665255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:51:42.665255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:51:42.665255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:51:42.665255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:51:42.665255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:51:42.665255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:51:42.665255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:51:42.665255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:51:42.665255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:51:42.665255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:51:42.665255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:51:42.665255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:51:42.666116 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:51:42.666116 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:51:42.666116 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:51:42.666116 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:51:42.666116 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:51:42.666116 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:51:42.666116 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:51:42.666116 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:51:42.666116 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:51:42.666116 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:51:42.666116 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:51:42.666116 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:51:42.666116 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:51:42.666116 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:51:42.666116 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:51:42.666116 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:51:42.666869 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:51:42.666869 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:51:42.666869 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:51:42.666869 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:51:42.666869 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:51:42.666869 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:51:42.666869 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:51:42.666869 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:51:42.666869 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:51:42.666869 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:51:42.666869 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:51:42.666869 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:51:42.666869 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 69/152] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 27 18:51:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:51:42.672649 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b44886-7d0e-4511-ade1-b2e006ca8c44 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:42.853627 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:42.862831 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b44886-7d0e-4511-ade1-b2e006ca8c44 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:42.880148 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef5e28-65fe-4c9b-b132-b0e48082f0b3 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:42.880677 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef5e28-65fe-4c9b-b132-b0e48082f0b3 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:42.880677 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef5e28-65fe-4c9b-b132-b0e48082f0b3 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:42.882175 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 70/153] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:51:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:51:42.890793 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed57cf0-f75f-4e10-b628-cb876ba18a43 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:42.891072 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed57cf0-f75f-4e10-b628-cb876ba18a43 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:42.891343 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed57cf0-f75f-4e10-b628-cb876ba18a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:42.914569 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-3ed57cf0-f75f-4e10-b628-cb876ba18a43 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:51:42.916317 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-3ed57cf0-f75f-4e10-b628-cb876ba18a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:42.920432 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072a62e-f987-455a-8905-f600f4617751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:42.921620 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072a62e-f987-455a-8905-f600f4617751 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:42.922071 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072a62e-f987-455a-8905-f600f4617751 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:42.922672 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072a62e-f987-455a-8905-f600f4617751 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:42.924059 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a072a62e-f987-455a-8905-f600f4617751 None admin] RBAC: Adding query filter params (name=member) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:51:42.924758 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a072a62e-f987-455a-8905-f600f4617751 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:42.927322 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a072a62e-f987-455a-8905-f600f4617751 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:42.941545 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 84/154] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 27 18:51:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:42.948050 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072a62e-f987-455a-8905-f600f4617751 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:43.023001 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 71/155] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:51:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:51:43.024937 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67318b-4b00-4254-b99f-133e3c66378a None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:43.025367 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67318b-4b00-4254-b99f-133e3c66378a None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:43.025778 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67318b-4b00-4254-b99f-133e3c66378a None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:43.028193 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 72/156] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:51:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:51:43.035043 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64d4bf-ad55-44a9-a75c-4f03b7f1ab81 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:43.035452 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64d4bf-ad55-44a9-a75c-4f03b7f1ab81 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:43.035921 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64d4bf-ad55-44a9-a75c-4f03b7f1ab81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:43.057208 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-4c64d4bf-ad55-44a9-a75c-4f03b7f1ab81 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:51:43.058966 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-4c64d4bf-ad55-44a9-a75c-4f03b7f1ab81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:43.101412 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:43.107018 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072a62e-f987-455a-8905-f600f4617751 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:43.144431 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 73/157] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:51:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:51:43.145362 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c64d4bf-ad55-44a9-a75c-4f03b7f1ab81 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:43.162224 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19520a-e991-4333-9e8a-950b56a8c363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:43.163895 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19520a-e991-4333-9e8a-950b56a8c363 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:43.164599 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19520a-e991-4333-9e8a-950b56a8c363 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:43.165076 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19520a-e991-4333-9e8a-950b56a8c363 None admin] PATH_INFO: `/v3/users/78ed1d1d6c8a4c3ea357e2812cecb67f` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:43.166696 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd19520a-e991-4333-9e8a-950b56a8c363 None admin] RBAC: Authorizing `identity:get_user(user_id=78ed1d1d6c8a4c3ea357e2812cecb67f)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:43.168561 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd19520a-e991-4333-9e8a-950b56a8c363 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:43.171191 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 85/158] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 27 18:51:42 2022] GET /identity/v3/users/78ed1d1d6c8a4c3ea357e2812cecb67f => generated 275 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:51:43.176729 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19520a-e991-4333-9e8a-950b56a8c363 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:43.216575 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:43.284980 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c64d4bf-ad55-44a9-a75c-4f03b7f1ab81 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:43.312032 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19520a-e991-4333-9e8a-950b56a8c363 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:43.337547 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d0f1f-b5aa-4744-b688-e489101a9b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:43.338194 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d0f1f-b5aa-4744-b688-e489101a9b32 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:43.338475 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d0f1f-b5aa-4744-b688-e489101a9b32 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:43.338852 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d0f1f-b5aa-4744-b688-e489101a9b32 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:43.351538 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0d0f1f-b5aa-4744-b688-e489101a9b32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:51:43.356331 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39367b39-3028-494f-ad36-c1104fd3ad81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:43.357199 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39367b39-3028-494f-ad36-c1104fd3ad81 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:43.357461 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-ea0d0f1f-b5aa-4744-b688-e489101a9b32 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 18:51:43.357461 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:51:43.357461 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:51:43.357461 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:51:43.357461 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:51:43.357461 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:51:43.357461 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:51:43.357461 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:51:43.357461 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:51:43.357461 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:51:43.357461 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:51:43.357461 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:51:43.357461 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:51:43.357461 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:51:43.357461 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:51:43.357461 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:51:43.359269 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:51:43.359269 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:51:43.359269 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:51:43.359269 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:51:43.359269 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:51:43.359269 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:51:43.359269 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:51:43.359269 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:51:43.359269 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:51:43.359269 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:51:43.359269 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:51:43.359269 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:51:43.359269 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:51:43.359269 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:51:43.359269 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:51:43.359269 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:51:43.360953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:51:43.360953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:51:43.360953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:51:43.360953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:51:43.360953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:51:43.360953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:51:43.360953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:51:43.360953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:51:43.360953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:51:43.360953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:51:43.360953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 18:51:43.360953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:51:43.362320 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39367b39-3028-494f-ad36-c1104fd3ad81 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:43.362320 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39367b39-3028-494f-ad36-c1104fd3ad81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:43.362440 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 74/159] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 27 18:51:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:51:43.362440 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d0f1f-b5aa-4744-b688-e489101a9b32 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:43.401729 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:43.474521 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39367b39-3028-494f-ad36-c1104fd3ad81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:43.476116 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39367b39-3028-494f-ad36-c1104fd3ad81 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:43.492952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d0f1f-b5aa-4744-b688-e489101a9b32 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:43.516383 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:43.535392 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f9e8d-fbd8-469f-a96d-30f91a44af90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:43.537674 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f9e8d-fbd8-469f-a96d-30f91a44af90 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:43.538215 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f9e8d-fbd8-469f-a96d-30f91a44af90 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:43.538679 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f9e8d-fbd8-469f-a96d-30f91a44af90 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:43.553724 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9f9e8d-fbd8-469f-a96d-30f91a44af90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:51:43.561688 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-7b9f9e8d-fbd8-469f-a96d-30f91a44af90 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:51:43.561688 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:51:43.561688 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:51:43.561688 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:51:43.561688 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:51:43.561688 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:51:43.561688 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:51:43.561688 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:51:43.561688 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:51:43.561688 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:51:43.561688 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:51:43.561688 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:51:43.561688 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:51:43.561688 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:51:43.561688 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:51:43.561688 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:51:43.562639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:51:43.562639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:51:43.562639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:51:43.562639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:51:43.562639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:51:43.562639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:51:43.562639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:51:43.562639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:51:43.562639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:51:43.562639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:51:43.562639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:51:43.562639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:51:43.562639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:51:43.562639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:51:43.562639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:51:43.562639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:51:43.563386 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:51:43.563386 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:51:43.563386 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:51:43.563386 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:51:43.563386 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:51:43.563386 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:51:43.563386 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:51:43.563386 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:51:43.563386 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:51:43.563386 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:51:43.563386 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:51:43.563386 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:51:43.563386 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 75/160] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 27 18:51:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:51:43.565457 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd866737-1dd6-4fdb-9d41-d33707033067 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:43.565457 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd866737-1dd6-4fdb-9d41-d33707033067 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:43.565457 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd866737-1dd6-4fdb-9d41-d33707033067 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:43.567410 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 76/161] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:51:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:51:43.568458 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd866737-1dd6-4fdb-9d41-d33707033067 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:43.612042 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 86/162] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 27 18:51:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 18:51:43.613312 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f36b61-d3d7-45f2-8a6e-727ef9a677d0 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:43.613597 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f36b61-d3d7-45f2-8a6e-727ef9a677d0 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:43.613871 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f36b61-d3d7-45f2-8a6e-727ef9a677d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:43.639416 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-29f36b61-d3d7-45f2-8a6e-727ef9a677d0 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:51:43.640634 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-29f36b61-d3d7-45f2-8a6e-727ef9a677d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:43.682705 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:43.699281 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd866737-1dd6-4fdb-9d41-d33707033067 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:43.717568 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 87/163] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:51:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:51:43.718576 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f36b61-d3d7-45f2-8a6e-727ef9a677d0 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:43.737637 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c328131-ee95-4586-9829-2650a749ea1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:43.738363 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c328131-ee95-4586-9829-2650a749ea1a None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:43.738646 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c328131-ee95-4586-9829-2650a749ea1a None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:43.739015 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c328131-ee95-4586-9829-2650a749ea1a None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:43.739771 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c328131-ee95-4586-9829-2650a749ea1a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:51:43.740077 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c328131-ee95-4586-9829-2650a749ea1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:43.741473 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c328131-ee95-4586-9829-2650a749ea1a None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:43.750742 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 77/164] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 27 18:51:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:43.751466 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c328131-ee95-4586-9829-2650a749ea1a None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:43.782744 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:43.826043 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f36b61-d3d7-45f2-8a6e-727ef9a677d0 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:43.856211 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c328131-ee95-4586-9829-2650a749ea1a None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:43.863643 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bea33e-16ab-454b-a0bb-f749db8c300a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:43.864401 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bea33e-16ab-454b-a0bb-f749db8c300a None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:43.864745 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bea33e-16ab-454b-a0bb-f749db8c300a None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:43.865083 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bea33e-16ab-454b-a0bb-f749db8c300a None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:43.865894 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bea33e-16ab-454b-a0bb-f749db8c300a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:51:43.866327 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bea33e-16ab-454b-a0bb-f749db8c300a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:43.868012 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bea33e-16ab-454b-a0bb-f749db8c300a None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:43.891715 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea7f28-b416-42c4-b35f-c9ca621b6175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:43.892390 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea7f28-b416-42c4-b35f-c9ca621b6175 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:43.892623 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea7f28-b416-42c4-b35f-c9ca621b6175 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:43.892895 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea7f28-b416-42c4-b35f-c9ca621b6175 None admin] PATH_INFO: `/v3/projects/d85bb1f7e9394d898e25c565c5043262` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:43.894072 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ea7f28-b416-42c4-b35f-c9ca621b6175 None admin] RBAC: Authorizing `identity:get_project(project_id=d85bb1f7e9394d898e25c565c5043262)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:43.895525 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ea7f28-b416-42c4-b35f-c9ca621b6175 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:43.896131 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 88/165] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 27 18:51:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:43.897003 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bea33e-16ab-454b-a0bb-f749db8c300a None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:43.897572 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 78/166] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 27 18:51:43 2022] GET /identity/v3/projects/d85bb1f7e9394d898e25c565c5043262 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:43.898442 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea7f28-b416-42c4-b35f-c9ca621b6175 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:43.928171 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:44.001591 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea7f28-b416-42c4-b35f-c9ca621b6175 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:44.057468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac9bfd4-884d-4b76-a045-3700c69bbb11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:44.058216 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9bfd4-884d-4b76-a045-3700c69bbb11 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:44.058500 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9bfd4-884d-4b76-a045-3700c69bbb11 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:44.058774 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9bfd4-884d-4b76-a045-3700c69bbb11 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:44.073422 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bea33e-16ab-454b-a0bb-f749db8c300a None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:44.081920 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac9bfd4-884d-4b76-a045-3700c69bbb11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:51:44.087903 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-5ac9bfd4-884d-4b76-a045-3700c69bbb11 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:51:44.087903 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:51:44.087903 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:51:44.087903 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:51:44.087903 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:51:44.087903 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:51:44.087903 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:51:44.087903 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:51:44.087903 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:51:44.087903 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:51:44.087903 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:51:44.087903 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:51:44.087903 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:51:44.087903 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:51:44.087903 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:51:44.087903 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:51:44.089001 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:51:44.089001 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:51:44.089001 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:51:44.089001 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:51:44.089001 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:51:44.089001 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:51:44.089001 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:51:44.089001 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:51:44.089001 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:51:44.089001 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:51:44.089001 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:51:44.089001 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:51:44.089001 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:51:44.089001 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:51:44.089001 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:51:44.089001 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:51:44.089909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:51:44.089909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:51:44.089909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:51:44.089909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:51:44.089909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:51:44.089909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:51:44.089909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:51:44.089909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:51:44.089909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:51:44.089909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:51:44.089909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:51:44.089909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:51:44.089909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 79/167] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 27 18:51:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:51:44.100052 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:44.100770 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac9bfd4-884d-4b76-a045-3700c69bbb11 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:44.122428 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15386320-b972-4288-8944-5117788b0878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:44.123279 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15386320-b972-4288-8944-5117788b0878 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:44.123884 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15386320-b972-4288-8944-5117788b0878 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:44.124302 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15386320-b972-4288-8944-5117788b0878 None admin] PATH_INFO: `/v3/users/b6d9213375084a0da9c98667e897f8a3` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:44.125640 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15386320-b972-4288-8944-5117788b0878 None admin] RBAC: Authorizing `identity:get_user(user_id=b6d9213375084a0da9c98667e897f8a3)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:44.128775 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15386320-b972-4288-8944-5117788b0878 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:44.131993 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 89/168] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 27 18:51:43 2022] GET /identity/v3/users/b6d9213375084a0da9c98667e897f8a3 => generated 289 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:44.135093 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15386320-b972-4288-8944-5117788b0878 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:44.214363 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:44.243271 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac9bfd4-884d-4b76-a045-3700c69bbb11 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:44.299418 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15386320-b972-4288-8944-5117788b0878 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:44.338632 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eda288-aa34-493d-8282-6d5b274b20c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:44.340570 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eda288-aa34-493d-8282-6d5b274b20c4 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:44.341314 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eda288-aa34-493d-8282-6d5b274b20c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:44.341786 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eda288-aa34-493d-8282-6d5b274b20c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:44.342774 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eda288-aa34-493d-8282-6d5b274b20c4 None admin] RBAC: Adding query filter params (role.id=448ae448fe9a474ab1166ca18f7ac4d8, scope.project.id=d85bb1f7e9394d898e25c565c5043262, user.id=78ed1d1d6c8a4c3ea357e2812cecb67f) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:51:44.343312 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eda288-aa34-493d-8282-6d5b274b20c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:44.345559 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eda288-aa34-493d-8282-6d5b274b20c4 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:44.352172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 90/169] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 27 18:51:44 2022] GET /identity/v3/role_assignments?user.id=78ed1d1d6c8a4c3ea357e2812cecb67f&scope.project.id=d85bb1f7e9394d898e25c565c5043262&role.id=448ae448fe9a474ab1166ca18f7ac4d8 => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:44.353210 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eda288-aa34-493d-8282-6d5b274b20c4 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:44.368416 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a055f9db-a9b5-4a36-9e87-b16e73317e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:44.369079 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055f9db-a9b5-4a36-9e87-b16e73317e95 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:44.369418 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055f9db-a9b5-4a36-9e87-b16e73317e95 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:44.369695 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055f9db-a9b5-4a36-9e87-b16e73317e95 None admin] PATH_INFO: `/v3/users/78ed1d1d6c8a4c3ea357e2812cecb67f` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:44.371494 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a055f9db-a9b5-4a36-9e87-b16e73317e95 None admin] RBAC: Authorizing `identity:get_user(user_id=78ed1d1d6c8a4c3ea357e2812cecb67f)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:44.373069 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a055f9db-a9b5-4a36-9e87-b16e73317e95 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:44.374669 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 80/170] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 27 18:51:44 2022] GET /identity/v3/users/78ed1d1d6c8a4c3ea357e2812cecb67f => generated 275 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:44.375511 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a055f9db-a9b5-4a36-9e87-b16e73317e95 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:44.440051 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:44.543729 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eda288-aa34-493d-8282-6d5b274b20c4 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:44.610585 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a055f9db-a9b5-4a36-9e87-b16e73317e95 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:44.620458 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc453a58-af7d-4cc9-bf12-8dc28e9c304b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:44.621641 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc453a58-af7d-4cc9-bf12-8dc28e9c304b None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:44.621921 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc453a58-af7d-4cc9-bf12-8dc28e9c304b None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:44.622192 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc453a58-af7d-4cc9-bf12-8dc28e9c304b None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:44.622927 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc453a58-af7d-4cc9-bf12-8dc28e9c304b None admin] RBAC: Adding query filter params (name=member) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:51:44.623288 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc453a58-af7d-4cc9-bf12-8dc28e9c304b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:44.630878 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc453a58-af7d-4cc9-bf12-8dc28e9c304b None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:44.647324 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 91/171] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 27 18:51:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:44.648203 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc453a58-af7d-4cc9-bf12-8dc28e9c304b None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:44.665970 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f163557d-10a2-465d-a9a9-5f7f034f1c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:44.666625 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f163557d-10a2-465d-a9a9-5f7f034f1c0d None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:44.667284 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f163557d-10a2-465d-a9a9-5f7f034f1c0d None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:44.667637 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f163557d-10a2-465d-a9a9-5f7f034f1c0d None admin] PATH_INFO: `/v3/projects/d85bb1f7e9394d898e25c565c5043262` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:44.669161 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f163557d-10a2-465d-a9a9-5f7f034f1c0d None admin] RBAC: Authorizing `identity:get_project(project_id=d85bb1f7e9394d898e25c565c5043262)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:44.670631 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f163557d-10a2-465d-a9a9-5f7f034f1c0d None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:44.673552 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 81/172] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 27 18:51:44 2022] GET /identity/v3/projects/d85bb1f7e9394d898e25c565c5043262 => generated 298 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:44.674319 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f163557d-10a2-465d-a9a9-5f7f034f1c0d None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:44.696974 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:44.799192 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f163557d-10a2-465d-a9a9-5f7f034f1c0d None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:44.840217 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b7e26-3961-417e-bdd4-f93523331f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:44.841205 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b7e26-3961-417e-bdd4-f93523331f27 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:44.841630 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b7e26-3961-417e-bdd4-f93523331f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:44.841912 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b7e26-3961-417e-bdd4-f93523331f27 None admin] PATH_INFO: `/v3/users/78ed1d1d6c8a4c3ea357e2812cecb67f` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:44.843107 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2b7e26-3961-417e-bdd4-f93523331f27 None admin] RBAC: Authorizing `identity:get_user(user_id=78ed1d1d6c8a4c3ea357e2812cecb67f)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:44.844724 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2b7e26-3961-417e-bdd4-f93523331f27 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:44.845812 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc453a58-af7d-4cc9-bf12-8dc28e9c304b None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:44.846505 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 82/173] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 27 18:51:44 2022] GET /identity/v3/users/78ed1d1d6c8a4c3ea357e2812cecb67f => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:44.847087 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b7e26-3961-417e-bdd4-f93523331f27 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:44.884118 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:44.913760 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82741ab-21ae-459b-9ccb-b3b483adcd1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:44.914527 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82741ab-21ae-459b-9ccb-b3b483adcd1c None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:44.914813 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82741ab-21ae-459b-9ccb-b3b483adcd1c None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:44.915088 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82741ab-21ae-459b-9ccb-b3b483adcd1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:44.947240 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:44.969145 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b7e26-3961-417e-bdd4-f93523331f27 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:44.998626 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82741ab-21ae-459b-9ccb-b3b483adcd1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:45.000166 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82741ab-21ae-459b-9ccb-b3b483adcd1c None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:45.010658 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793782c4-9cf5-48d1-bccd-4d73dc1e337c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:45.011893 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793782c4-9cf5-48d1-bccd-4d73dc1e337c None admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:45.012176 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793782c4-9cf5-48d1-bccd-4d73dc1e337c None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:45.012447 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793782c4-9cf5-48d1-bccd-4d73dc1e337c None admin] PATH_INFO: `/v3/projects/d85bb1f7e9394d898e25c565c5043262/users/b6d9213375084a0da9c98667e897f8a3/roles/7cf1c5f66b514f79bd5f95c17ac73d46` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:45.015367 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793782c4-9cf5-48d1-bccd-4d73dc1e337c None admin] RBAC: Authorizing `identity:create_grant(project_id=d85bb1f7e9394d898e25c565c5043262, user_id=b6d9213375084a0da9c98667e897f8a3, role_id=7cf1c5f66b514f79bd5f95c17ac73d46)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:45.017006 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793782c4-9cf5-48d1-bccd-4d73dc1e337c None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:45.036839 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 83/174] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 27 18:51:44 2022] PUT /identity/v3/projects/d85bb1f7e9394d898e25c565c5043262/users/b6d9213375084a0da9c98667e897f8a3/roles/7cf1c5f66b514f79bd5f95c17ac73d46 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:51:45.037743 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793782c4-9cf5-48d1-bccd-4d73dc1e337c None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:45.194195 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793782c4-9cf5-48d1-bccd-4d73dc1e337c None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:45.203121 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 92/175] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 27 18:51:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:51:45.208922 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82741ab-21ae-459b-9ccb-b3b483adcd1c None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:45.233089 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920f307-45e0-4eea-9b30-0c43bf25cb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:45.233710 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920f307-45e0-4eea-9b30-0c43bf25cb88 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:45.233986 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920f307-45e0-4eea-9b30-0c43bf25cb88 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:45.234257 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920f307-45e0-4eea-9b30-0c43bf25cb88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:45.235145 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:45.253403 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:45.317644 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0920f307-45e0-4eea-9b30-0c43bf25cb88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:45.319150 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0920f307-45e0-4eea-9b30-0c43bf25cb88 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:45.331490 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82741ab-21ae-459b-9ccb-b3b483adcd1c None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:45.367112 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46889f4-6dde-42f6-918d-209f2877959f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:45.367792 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46889f4-6dde-42f6-918d-209f2877959f None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:45.368074 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46889f4-6dde-42f6-918d-209f2877959f None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:45.368346 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46889f4-6dde-42f6-918d-209f2877959f None admin] PATH_INFO: `/v3/projects/d85bb1f7e9394d898e25c565c5043262` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:45.369523 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46889f4-6dde-42f6-918d-209f2877959f None admin] RBAC: Authorizing `identity:get_project(project_id=d85bb1f7e9394d898e25c565c5043262)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:45.371516 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46889f4-6dde-42f6-918d-209f2877959f None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:45.373397 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 93/176] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 27 18:51:45 2022] GET /identity/v3/projects/d85bb1f7e9394d898e25c565c5043262 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:45.379026 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46889f4-6dde-42f6-918d-209f2877959f None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:45.431585 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 84/177] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 27 18:51:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:51:45.440711 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920f307-45e0-4eea-9b30-0c43bf25cb88 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:45.476292 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:45.493230 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46889f4-6dde-42f6-918d-209f2877959f None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:45.504139 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:45.535453 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fbfd49-d62d-4548-94bc-75c645c10ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:45.536115 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbfd49-d62d-4548-94bc-75c645c10ad8 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:45.536397 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbfd49-d62d-4548-94bc-75c645c10ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:45.536675 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbfd49-d62d-4548-94bc-75c645c10ad8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:45.537553 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fbfd49-d62d-4548-94bc-75c645c10ad8 None admin] RBAC: Adding query filter params (role.id=8d808722e03a4591a59440f170ec672f, scope.project.id=d85bb1f7e9394d898e25c565c5043262, user.id=78ed1d1d6c8a4c3ea357e2812cecb67f) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:51:45.537867 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fbfd49-d62d-4548-94bc-75c645c10ad8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:45.539298 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fbfd49-d62d-4548-94bc-75c645c10ad8 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:45.546126 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 94/178] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 27 18:51:45 2022] GET /identity/v3/role_assignments?user.id=78ed1d1d6c8a4c3ea357e2812cecb67f&scope.project.id=d85bb1f7e9394d898e25c565c5043262&role.id=8d808722e03a4591a59440f170ec672f => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:51:45.604174 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920f307-45e0-4eea-9b30-0c43bf25cb88 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:45.656031 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073e5a1-d631-4d18-81ba-01959fc78533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:45.656708 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073e5a1-d631-4d18-81ba-01959fc78533 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:45.656988 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073e5a1-d631-4d18-81ba-01959fc78533 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:45.657261 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073e5a1-d631-4d18-81ba-01959fc78533 None admin] PATH_INFO: `/v3/projects/b7237ee3a0e64d3280478e6e61059e9f` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:45.658498 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9073e5a1-d631-4d18-81ba-01959fc78533 None admin] RBAC: Authorizing `identity:get_project(project_id=b7237ee3a0e64d3280478e6e61059e9f)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:45.660083 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9073e5a1-d631-4d18-81ba-01959fc78533 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:45.661788 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 85/179] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 27 18:51:45 2022] GET /identity/v3/projects/b7237ee3a0e64d3280478e6e61059e9f => generated 312 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:45.667952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fbfd49-d62d-4548-94bc-75c645c10ad8 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:45.729769 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244bf5d-132d-4bab-ac34-e7ab82b6d849 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:45.730945 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244bf5d-132d-4bab-ac34-e7ab82b6d849 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:45.731430 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244bf5d-132d-4bab-ac34-e7ab82b6d849 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:45.733000 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 86/180] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:51:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:51:45.740732 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42429c-e91f-414a-997c-4d349d536d8d None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:45.741325 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42429c-e91f-414a-997c-4d349d536d8d None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:45.741837 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42429c-e91f-414a-997c-4d349d536d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:45.769669 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-cc42429c-e91f-414a-997c-4d349d536d8d None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:51:45.776218 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-cc42429c-e91f-414a-997c-4d349d536d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:45.798958 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fbfd49-d62d-4548-94bc-75c645c10ad8 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:45.836042 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280f7ec7-be63-4746-a4fc-eb984f9765c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:45.836724 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280f7ec7-be63-4746-a4fc-eb984f9765c8 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:45.836951 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280f7ec7-be63-4746-a4fc-eb984f9765c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:45.837220 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280f7ec7-be63-4746-a4fc-eb984f9765c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:45.838037 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280f7ec7-be63-4746-a4fc-eb984f9765c8 None admin] RBAC: Adding query filter params (role.id=448ae448fe9a474ab1166ca18f7ac4d8, scope.project.id=b7237ee3a0e64d3280478e6e61059e9f, user.id=78ed1d1d6c8a4c3ea357e2812cecb67f) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:51:45.838345 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280f7ec7-be63-4746-a4fc-eb984f9765c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:45.840471 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280f7ec7-be63-4746-a4fc-eb984f9765c8 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:45.852310 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 95/181] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 27 18:51:45 2022] GET /identity/v3/role_assignments?user.id=78ed1d1d6c8a4c3ea357e2812cecb67f&scope.project.id=b7237ee3a0e64d3280478e6e61059e9f&role.id=448ae448fe9a474ab1166ca18f7ac4d8 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:45.897596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 87/182] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:51:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 27 18:51:45.931276 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280f7ec7-be63-4746-a4fc-eb984f9765c8 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:45.949623 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:46.066595 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280f7ec7-be63-4746-a4fc-eb984f9765c8 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:46.103672 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b98e6-024b-46ed-b3b8-ba81dc93c692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:46.104334 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b98e6-024b-46ed-b3b8-ba81dc93c692 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:46.104611 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b98e6-024b-46ed-b3b8-ba81dc93c692 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:46.104919 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b98e6-024b-46ed-b3b8-ba81dc93c692 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:46.116681 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b98e6-024b-46ed-b3b8-ba81dc93c692 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:51:46.123362 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-e76b98e6-024b-46ed-b3b8-ba81dc93c692 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:51:46.123362 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:51:46.123362 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:51:46.123362 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:51:46.123362 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:51:46.123362 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:51:46.123362 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:51:46.123362 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:51:46.123362 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:51:46.123362 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:51:46.123362 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:51:46.123362 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:51:46.123362 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:51:46.123362 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:51:46.123362 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:51:46.123362 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:51:46.124257 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:51:46.124257 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:51:46.124257 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:51:46.124257 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:51:46.124257 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:51:46.124257 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:51:46.124257 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:51:46.124257 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:51:46.124257 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:51:46.124257 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:51:46.124257 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:51:46.124257 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:51:46.124257 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:51:46.124257 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:51:46.124257 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:51:46.124257 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:51:46.125035 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:51:46.125035 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:51:46.125035 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:51:46.125035 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:51:46.125035 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:51:46.125035 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:51:46.125035 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:51:46.125035 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:51:46.125035 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:51:46.125035 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:51:46.125035 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:51:46.125035 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:51:46.125035 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 96/183] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 27 18:51:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:51:46.130844 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc42429c-e91f-414a-997c-4d349d536d8d None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:46.177939 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:46.190467 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c8208-1b5e-4562-8548-a01f60bce653 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:46.190884 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c8208-1b5e-4562-8548-a01f60bce653 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:46.191258 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c8208-1b5e-4562-8548-a01f60bce653 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:46.192626 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 97/184] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:51:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:51:46.195896 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1d3e3-3174-41e7-9ac4-5378b5a2a20b None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:46.196170 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1d3e3-3174-41e7-9ac4-5378b5a2a20b None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:46.196513 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1d3e3-3174-41e7-9ac4-5378b5a2a20b None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:46.197734 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 98/185] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:51:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:51:46.201476 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56600d5-28d3-4348-b1b5-1983ffb949d9 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:46.201752 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56600d5-28d3-4348-b1b5-1983ffb949d9 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:46.202092 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56600d5-28d3-4348-b1b5-1983ffb949d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:46.230342 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-c56600d5-28d3-4348-b1b5-1983ffb949d9 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:51:46.231878 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-c56600d5-28d3-4348-b1b5-1983ffb949d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:46.253713 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc42429c-e91f-414a-997c-4d349d536d8d None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:46.306978 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3c558-596d-490a-afe9-4c15dee0d546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:46.307971 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3c558-596d-490a-afe9-4c15dee0d546 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:46.308261 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3c558-596d-490a-afe9-4c15dee0d546 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:46.308560 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3c558-596d-490a-afe9-4c15dee0d546 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:46.309289 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e3c558-596d-490a-afe9-4c15dee0d546 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:51:46.309593 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e3c558-596d-490a-afe9-4c15dee0d546 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:46.310966 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e3c558-596d-490a-afe9-4c15dee0d546 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:46.312411 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 99/186] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:51:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:51:46.314085 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177213b-907d-4e87-9121-6a2fb171ce8a None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:46.314600 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177213b-907d-4e87-9121-6a2fb171ce8a None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:46.315011 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177213b-907d-4e87-9121-6a2fb171ce8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:46.320354 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 88/187] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 27 18:51:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:51:46.326289 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3c558-596d-490a-afe9-4c15dee0d546 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:46.333925 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-0177213b-907d-4e87-9121-6a2fb171ce8a None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:51:46.335375 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-0177213b-907d-4e87-9121-6a2fb171ce8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:46.344148 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:46.407902 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 100/188] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:51:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:51:46.408643 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0177213b-907d-4e87-9121-6a2fb171ce8a None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:46.440674 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3c558-596d-490a-afe9-4c15dee0d546 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:46.443905 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:46.479628 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f99ac45-88af-4892-a2cf-ff8e15066635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:46.480329 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f99ac45-88af-4892-a2cf-ff8e15066635 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:46.480610 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f99ac45-88af-4892-a2cf-ff8e15066635 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:46.481560 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f99ac45-88af-4892-a2cf-ff8e15066635 None admin] PATH_INFO: `/v3/users/a3c62bc78aff4ac69f17dd12a648d0ee` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:46.494720 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f99ac45-88af-4892-a2cf-ff8e15066635 None admin] RBAC: Authorizing `identity:get_user(user_id=a3c62bc78aff4ac69f17dd12a648d0ee)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:46.496210 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f99ac45-88af-4892-a2cf-ff8e15066635 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:46.502440 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 89/189] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 27 18:51:46 2022] GET /identity/v3/users/a3c62bc78aff4ac69f17dd12a648d0ee => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:46.502440 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f99ac45-88af-4892-a2cf-ff8e15066635 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:46.515861 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0177213b-907d-4e87-9121-6a2fb171ce8a None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:46.547722 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:46.553513 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f262124-c5bd-4f9c-826d-fc59d6a3812c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:46.554147 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f262124-c5bd-4f9c-826d-fc59d6a3812c None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:46.554428 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f262124-c5bd-4f9c-826d-fc59d6a3812c None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:46.554699 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f262124-c5bd-4f9c-826d-fc59d6a3812c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:46.555955 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f262124-c5bd-4f9c-826d-fc59d6a3812c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:46.557491 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f262124-c5bd-4f9c-826d-fc59d6a3812c None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:46.563525 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 101/190] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:51:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:46.563525 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f262124-c5bd-4f9c-826d-fc59d6a3812c None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:46.611211 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f99ac45-88af-4892-a2cf-ff8e15066635 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:46.645547 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f15f3f-89aa-4f80-a7cb-ce561a95ca53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:46.646327 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f15f3f-89aa-4f80-a7cb-ce561a95ca53 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:46.646615 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f15f3f-89aa-4f80-a7cb-ce561a95ca53 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:46.646888 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f15f3f-89aa-4f80-a7cb-ce561a95ca53 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:46.658066 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f15f3f-89aa-4f80-a7cb-ce561a95ca53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:51:46.662933 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-f8f15f3f-89aa-4f80-a7cb-ce561a95ca53 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:51:46.662933 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:51:46.662933 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:51:46.662933 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:51:46.662933 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:51:46.662933 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:51:46.662933 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:51:46.662933 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:51:46.662933 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:51:46.662933 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:51:46.662933 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:51:46.662933 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:51:46.662933 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:51:46.662933 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:51:46.662933 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:51:46.662933 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:51:46.664007 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:51:46.664007 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:51:46.664007 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:51:46.664007 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:51:46.664007 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:51:46.664007 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:51:46.664007 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:51:46.664007 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:51:46.664007 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:51:46.664007 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:51:46.664007 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:51:46.664007 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:51:46.664007 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:51:46.664007 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:51:46.664007 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:51:46.664007 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:51:46.664845 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:51:46.664845 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:51:46.664845 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:51:46.664845 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:51:46.664845 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:51:46.664845 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:51:46.664845 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:51:46.664845 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:51:46.664845 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:51:46.664845 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:51:46.664845 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:51:46.664845 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:51:46.664845 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 90/191] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 27 18:51:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:51:46.665503 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f15f3f-89aa-4f80-a7cb-ce561a95ca53 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:46.673040 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f262124-c5bd-4f9c-826d-fc59d6a3812c None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:46.691413 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:46.710867 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca8d6ce-afb0-410f-b995-28856eb8b052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:46.711501 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8d6ce-afb0-410f-b995-28856eb8b052 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:46.711813 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8d6ce-afb0-410f-b995-28856eb8b052 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:46.712093 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8d6ce-afb0-410f-b995-28856eb8b052 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:46.768946 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f15f3f-89aa-4f80-a7cb-ce561a95ca53 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:46.785445 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:46.788304 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca8d6ce-afb0-410f-b995-28856eb8b052 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:46.790130 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca8d6ce-afb0-410f-b995-28856eb8b052 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:46.805033 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fcecc4-c6e5-4164-a8c5-972b61b6c9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:46.805643 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fcecc4-c6e5-4164-a8c5-972b61b6c9fa None admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:46.805918 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fcecc4-c6e5-4164-a8c5-972b61b6c9fa None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:46.806191 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fcecc4-c6e5-4164-a8c5-972b61b6c9fa None admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:46.806871 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fcecc4-c6e5-4164-a8c5-972b61b6c9fa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:46.808870 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fcecc4-c6e5-4164-a8c5-972b61b6c9fa None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:46.829792 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 91/192] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Jul 27 18:51:46 2022] POST /identity/v3/users => generated 297 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:51:46.830914 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fcecc4-c6e5-4164-a8c5-972b61b6c9fa None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:46.932023 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 102/193] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 27 18:51:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:51:46.934112 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca8d6ce-afb0-410f-b995-28856eb8b052 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:46.957083 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:46.991862 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fcecc4-c6e5-4164-a8c5-972b61b6c9fa None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:47.037695 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad48bd5-7bb9-495d-8c78-3aff1fa6d0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:47.038560 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad48bd5-7bb9-495d-8c78-3aff1fa6d0c5 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:47.038843 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad48bd5-7bb9-495d-8c78-3aff1fa6d0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:47.039118 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad48bd5-7bb9-495d-8c78-3aff1fa6d0c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:47.039887 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad48bd5-7bb9-495d-8c78-3aff1fa6d0c5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:51:47.040197 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad48bd5-7bb9-495d-8c78-3aff1fa6d0c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:47.041580 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad48bd5-7bb9-495d-8c78-3aff1fa6d0c5 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:47.050940 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 92/194] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 27 18:51:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:47.056378 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad48bd5-7bb9-495d-8c78-3aff1fa6d0c5 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:47.057092 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca8d6ce-afb0-410f-b995-28856eb8b052 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:47.059372 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:47.097938 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c1ad6f-5ae7-4b94-a1f7-e98a74d83669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:47.098575 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1ad6f-5ae7-4b94-a1f7-e98a74d83669 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:47.098849 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1ad6f-5ae7-4b94-a1f7-e98a74d83669 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:47.099118 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1ad6f-5ae7-4b94-a1f7-e98a74d83669 None admin] PATH_INFO: `/v3/projects/fb4af7b5833b4b5b84a3c061a2fc98c8` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:47.101128 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c1ad6f-5ae7-4b94-a1f7-e98a74d83669 None admin] RBAC: Authorizing `identity:get_project(project_id=fb4af7b5833b4b5b84a3c061a2fc98c8)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:47.102565 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c1ad6f-5ae7-4b94-a1f7-e98a74d83669 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:47.104592 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 103/195] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 27 18:51:46 2022] GET /identity/v3/projects/fb4af7b5833b4b5b84a3c061a2fc98c8 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:47.114044 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c1ad6f-5ae7-4b94-a1f7-e98a74d83669 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:47.177533 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad48bd5-7bb9-495d-8c78-3aff1fa6d0c5 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:47.219105 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5152afd-8341-4653-b2d4-33fd9da8ca1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:47.219675 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5152afd-8341-4653-b2d4-33fd9da8ca1f None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:47.219982 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5152afd-8341-4653-b2d4-33fd9da8ca1f None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:47.220306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5152afd-8341-4653-b2d4-33fd9da8ca1f None admin] PATH_INFO: `/v3/users/a3c62bc78aff4ac69f17dd12a648d0ee` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:47.221548 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5152afd-8341-4653-b2d4-33fd9da8ca1f None admin] RBAC: Authorizing `identity:get_user(user_id=a3c62bc78aff4ac69f17dd12a648d0ee)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:47.223155 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5152afd-8341-4653-b2d4-33fd9da8ca1f None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:47.224801 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 93/196] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 27 18:51:47 2022] GET /identity/v3/users/a3c62bc78aff4ac69f17dd12a648d0ee => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:51:47.230977 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5152afd-8341-4653-b2d4-33fd9da8ca1f None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:47.236864 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c1ad6f-5ae7-4b94-a1f7-e98a74d83669 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:47.245337 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:47.286687 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc22f7-6738-42c1-a0a9-dca0bc50d775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:47.287314 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc22f7-6738-42c1-a0a9-dca0bc50d775 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:47.287596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc22f7-6738-42c1-a0a9-dca0bc50d775 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:47.287901 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc22f7-6738-42c1-a0a9-dca0bc50d775 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:47.288695 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfc22f7-6738-42c1-a0a9-dca0bc50d775 None admin] RBAC: Adding query filter params (role.id=0f4a39b061e148418413cfe647af9a34, scope.project.id=fb4af7b5833b4b5b84a3c061a2fc98c8, user.id=a3c62bc78aff4ac69f17dd12a648d0ee) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:51:47.289008 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfc22f7-6738-42c1-a0a9-dca0bc50d775 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:47.290440 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfc22f7-6738-42c1-a0a9-dca0bc50d775 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:47.297187 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 104/197] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 27 18:51:47 2022] GET /identity/v3/role_assignments?user.id=a3c62bc78aff4ac69f17dd12a648d0ee&scope.project.id=fb4af7b5833b4b5b84a3c061a2fc98c8&role.id=0f4a39b061e148418413cfe647af9a34 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:47.361201 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5152afd-8341-4653-b2d4-33fd9da8ca1f None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:47.399256 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea8d78-f100-4990-ac11-97535ab68c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:47.400287 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea8d78-f100-4990-ac11-97535ab68c6b None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:47.400746 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea8d78-f100-4990-ac11-97535ab68c6b None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:47.401193 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea8d78-f100-4990-ac11-97535ab68c6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:47.484885 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faea8d78-f100-4990-ac11-97535ab68c6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:47.486553 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faea8d78-f100-4990-ac11-97535ab68c6b None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:47.498385 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:47.627317 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 94/198] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 27 18:51:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 18:51:47.637350 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc22f7-6738-42c1-a0a9-dca0bc50d775 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:47.694498 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:47.742724 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5c1c5-7e6f-4578-bb51-ade6e8313390 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:47.743332 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5c1c5-7e6f-4578-bb51-ade6e8313390 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:47.744098 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5c1c5-7e6f-4578-bb51-ade6e8313390 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:47.747125 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 95/199] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:51:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:51:47.753142 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc59b6c-aebb-4158-b901-cec3b74ec74e None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:47.753684 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc59b6c-aebb-4158-b901-cec3b74ec74e None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:47.754152 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc59b6c-aebb-4158-b901-cec3b74ec74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:47.780331 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-fbc59b6c-aebb-4158-b901-cec3b74ec74e None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:51:47.781540 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-fbc59b6c-aebb-4158-b901-cec3b74ec74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:47.800332 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc22f7-6738-42c1-a0a9-dca0bc50d775 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:47.864611 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52cb6fd-addd-4b35-b60e-60f10932440b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:47.865261 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52cb6fd-addd-4b35-b60e-60f10932440b None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:47.865623 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52cb6fd-addd-4b35-b60e-60f10932440b None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:47.865913 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52cb6fd-addd-4b35-b60e-60f10932440b None admin] PATH_INFO: `/v3/projects/fb4af7b5833b4b5b84a3c061a2fc98c8` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:47.868154 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52cb6fd-addd-4b35-b60e-60f10932440b None admin] RBAC: Authorizing `identity:get_project(project_id=fb4af7b5833b4b5b84a3c061a2fc98c8)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:47.869602 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52cb6fd-addd-4b35-b60e-60f10932440b None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:47.872158 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 105/200] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 27 18:51:47 2022] GET /identity/v3/projects/fb4af7b5833b4b5b84a3c061a2fc98c8 => generated 302 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:47.884831 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52cb6fd-addd-4b35-b60e-60f10932440b None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:47.898509 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 96/201] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:51:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:51:47.921930 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc59b6c-aebb-4158-b901-cec3b74ec74e None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:47.968031 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:48.036037 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc59b6c-aebb-4158-b901-cec3b74ec74e None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:48.072364 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:48.076164 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52cb6fd-addd-4b35-b60e-60f10932440b None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:48.113777 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f0cc4-a3db-47c1-8cf8-9f84bdd8fdea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:48.114760 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f0cc4-a3db-47c1-8cf8-9f84bdd8fdea None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:48.115306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f0cc4-a3db-47c1-8cf8-9f84bdd8fdea None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:48.115802 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f0cc4-a3db-47c1-8cf8-9f84bdd8fdea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:48.116819 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f0cc4-a3db-47c1-8cf8-9f84bdd8fdea None admin] RBAC: Adding query filter params (role.id=8d808722e03a4591a59440f170ec672f, scope.project.id=fb4af7b5833b4b5b84a3c061a2fc98c8, user.id=a3c62bc78aff4ac69f17dd12a648d0ee) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:51:48.117327 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f0cc4-a3db-47c1-8cf8-9f84bdd8fdea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:48.118949 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f0cc4-a3db-47c1-8cf8-9f84bdd8fdea None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:48.121837 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5955d1-e2b7-4a65-8042-84565b58ac61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:48.122492 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5955d1-e2b7-4a65-8042-84565b58ac61 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:48.122769 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5955d1-e2b7-4a65-8042-84565b58ac61 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:48.123035 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5955d1-e2b7-4a65-8042-84565b58ac61 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:48.126873 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 106/202] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 27 18:51:47 2022] GET /identity/v3/role_assignments?user.id=a3c62bc78aff4ac69f17dd12a648d0ee&scope.project.id=fb4af7b5833b4b5b84a3c061a2fc98c8&role.id=8d808722e03a4591a59440f170ec672f => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:48.138305 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5955d1-e2b7-4a65-8042-84565b58ac61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:51:48.143864 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-9e5955d1-e2b7-4a65-8042-84565b58ac61 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 18:51:48.143864 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:51:48.143864 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:51:48.143864 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:51:48.143864 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:51:48.143864 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:51:48.143864 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:51:48.143864 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:51:48.143864 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:51:48.143864 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:51:48.143864 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:51:48.143864 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:51:48.143864 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:51:48.143864 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:51:48.143864 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:51:48.143864 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:51:48.144703 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:51:48.144703 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:51:48.144703 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:51:48.144703 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:51:48.144703 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:51:48.144703 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:51:48.144703 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:51:48.144703 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:51:48.144703 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:51:48.144703 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:51:48.144703 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:51:48.144703 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:51:48.144703 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:51:48.144703 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:51:48.144703 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:51:48.144703 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:51:48.145482 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:51:48.145482 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:51:48.145482 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:51:48.145482 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:51:48.145482 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:51:48.145482 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:51:48.145482 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:51:48.145482 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:51:48.145482 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:51:48.145482 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:51:48.145482 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 18:51:48.145482 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:51:48.147794 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 97/203] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 27 18:51:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:51:48.154217 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f0cc4-a3db-47c1-8cf8-9f84bdd8fdea None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:48.273983 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f0cc4-a3db-47c1-8cf8-9f84bdd8fdea None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:48.325295 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80102cf3-6be0-425e-bc23-9f88ca590fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:48.326255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80102cf3-6be0-425e-bc23-9f88ca590fd0 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:48.326734 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80102cf3-6be0-425e-bc23-9f88ca590fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:48.327269 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80102cf3-6be0-425e-bc23-9f88ca590fd0 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:48.328313 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80102cf3-6be0-425e-bc23-9f88ca590fd0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:51:48.328956 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80102cf3-6be0-425e-bc23-9f88ca590fd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:48.330517 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80102cf3-6be0-425e-bc23-9f88ca590fd0 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:48.344214 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 107/204] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 27 18:51:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:48.349995 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5955d1-e2b7-4a65-8042-84565b58ac61 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:48.471432 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:48.476608 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5955d1-e2b7-4a65-8042-84565b58ac61 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:48.512999 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e4a6d-bf11-4074-b708-120085c8b21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:48.513677 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e4a6d-bf11-4074-b708-120085c8b21b None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:48.513961 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e4a6d-bf11-4074-b708-120085c8b21b None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:48.514233 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e4a6d-bf11-4074-b708-120085c8b21b None admin] PATH_INFO: `/v3/users/b6d9213375084a0da9c98667e897f8a3` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:48.515399 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51e4a6d-bf11-4074-b708-120085c8b21b None admin] RBAC: Authorizing `identity:get_user(user_id=b6d9213375084a0da9c98667e897f8a3)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:48.516876 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51e4a6d-bf11-4074-b708-120085c8b21b None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:48.518484 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 98/205] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 27 18:51:48 2022] GET /identity/v3/users/b6d9213375084a0da9c98667e897f8a3 => generated 289 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:48.523970 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80102cf3-6be0-425e-bc23-9f88ca590fd0 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:48.565749 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:48.668379 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80102cf3-6be0-425e-bc23-9f88ca590fd0 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:48.717310 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886464cd-90d0-4dd9-92f4-6d585a04fd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:48.717997 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886464cd-90d0-4dd9-92f4-6d585a04fd44 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:48.718281 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886464cd-90d0-4dd9-92f4-6d585a04fd44 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:48.718555 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886464cd-90d0-4dd9-92f4-6d585a04fd44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:48.809478 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886464cd-90d0-4dd9-92f4-6d585a04fd44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:48.810960 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886464cd-90d0-4dd9-92f4-6d585a04fd44 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:48.844641 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:48.943482 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 108/206] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 27 18:51:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:51:48.948628 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e4a6d-bf11-4074-b708-120085c8b21b None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:49.099828 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e4a6d-bf11-4074-b708-120085c8b21b None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:49.135473 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c754a89-eb1a-4cc5-a593-d78c3e6c1ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:49.136537 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c754a89-eb1a-4cc5-a593-d78c3e6c1ba9 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:49.137009 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c754a89-eb1a-4cc5-a593-d78c3e6c1ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:49.137506 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c754a89-eb1a-4cc5-a593-d78c3e6c1ba9 None admin] PATH_INFO: `/v3/projects/d85bb1f7e9394d898e25c565c5043262` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:49.138869 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c754a89-eb1a-4cc5-a593-d78c3e6c1ba9 None admin] RBAC: Authorizing `identity:get_project(project_id=d85bb1f7e9394d898e25c565c5043262)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:49.140520 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c754a89-eb1a-4cc5-a593-d78c3e6c1ba9 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:49.142367 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 99/207] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 27 18:51:48 2022] GET /identity/v3/projects/d85bb1f7e9394d898e25c565c5043262 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:49.149192 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886464cd-90d0-4dd9-92f4-6d585a04fd44 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:49.258707 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886464cd-90d0-4dd9-92f4-6d585a04fd44 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:49.286310 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:49.297870 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84468711-1171-4138-a9aa-4b3d1b82c063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:49.298838 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84468711-1171-4138-a9aa-4b3d1b82c063 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:49.299309 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84468711-1171-4138-a9aa-4b3d1b82c063 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:49.299799 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84468711-1171-4138-a9aa-4b3d1b82c063 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:49.300778 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84468711-1171-4138-a9aa-4b3d1b82c063 None admin] RBAC: Adding query filter params (role.id=7cf1c5f66b514f79bd5f95c17ac73d46, scope.project.id=d85bb1f7e9394d898e25c565c5043262, user.id=b6d9213375084a0da9c98667e897f8a3) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:51:49.301303 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84468711-1171-4138-a9aa-4b3d1b82c063 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:49.302924 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84468711-1171-4138-a9aa-4b3d1b82c063 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:49.309677 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 109/208] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 27 18:51:49 2022] GET /identity/v3/role_assignments?user.id=b6d9213375084a0da9c98667e897f8a3&scope.project.id=d85bb1f7e9394d898e25c565c5043262&role.id=7cf1c5f66b514f79bd5f95c17ac73d46 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:49.351486 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457ba43-9fae-44f7-96cf-530248ff0c60 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:49.352050 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457ba43-9fae-44f7-96cf-530248ff0c60 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:49.352152 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457ba43-9fae-44f7-96cf-530248ff0c60 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:49.353961 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 100/209] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:51:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:51:49.359623 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744b2ca-0b05-408f-92d9-2c351f82caa9 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:49.360123 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744b2ca-0b05-408f-92d9-2c351f82caa9 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:49.360538 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744b2ca-0b05-408f-92d9-2c351f82caa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:49.388776 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-b744b2ca-0b05-408f-92d9-2c351f82caa9 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:51:49.390195 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-b744b2ca-0b05-408f-92d9-2c351f82caa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:49.474764 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 110/210] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:51:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:51:49.517385 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8457ba43-9fae-44f7-96cf-530248ff0c60 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:49.573638 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:49.644005 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8457ba43-9fae-44f7-96cf-530248ff0c60 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:49.681719 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf6fdf2-b80f-40f8-b921-d3eee852cd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:49.682357 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6fdf2-b80f-40f8-b921-d3eee852cd8c None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:49.682630 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6fdf2-b80f-40f8-b921-d3eee852cd8c None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:49.682936 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6fdf2-b80f-40f8-b921-d3eee852cd8c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:49.693411 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf6fdf2-b80f-40f8-b921-d3eee852cd8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:51:49.698370 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-4cf6fdf2-b80f-40f8-b921-d3eee852cd8c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:51:49.698370 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:51:49.698370 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:51:49.698370 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:51:49.698370 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:51:49.698370 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:51:49.698370 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:51:49.698370 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:51:49.698370 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:51:49.698370 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:51:49.698370 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:51:49.698370 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:51:49.698370 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:51:49.698370 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:51:49.698370 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:51:49.698370 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:51:49.699245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:51:49.699245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:51:49.699245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:51:49.699245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:51:49.699245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:51:49.699245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:51:49.699245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:51:49.699245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:51:49.699245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:51:49.699245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:51:49.699245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:51:49.699245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:51:49.699245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:51:49.699245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:51:49.699245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:51:49.699245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:51:49.700734 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:51:49.700734 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:51:49.700734 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:51:49.700734 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:51:49.700734 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:51:49.700734 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:51:49.700734 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:51:49.700734 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:51:49.700734 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:51:49.700734 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:51:49.700734 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:51:49.700734 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:51:49.700734 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 101/211] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 27 18:51:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:51:49.705746 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b744b2ca-0b05-408f-92d9-2c351f82caa9 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:49.819469 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304022a-15c3-4e67-bd65-ef777b965f1e None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:49.820099 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304022a-15c3-4e67-bd65-ef777b965f1e None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:49.820570 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304022a-15c3-4e67-bd65-ef777b965f1e None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:49.822115 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 102/212] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:51:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:51:49.825643 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b744b2ca-0b05-408f-92d9-2c351f82caa9 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:49.833115 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e9cf0-dac4-4350-95ea-6161912c30f6 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:49.833390 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e9cf0-dac4-4350-95ea-6161912c30f6 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:49.833663 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e9cf0-dac4-4350-95ea-6161912c30f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:49.851146 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:49.856074 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-414e9cf0-dac4-4350-95ea-6161912c30f6 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:51:49.857569 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-414e9cf0-dac4-4350-95ea-6161912c30f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:49.871852 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65294f9-d774-49ed-a63a-99ab975c579d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:49.872686 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65294f9-d774-49ed-a63a-99ab975c579d None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:49.873086 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65294f9-d774-49ed-a63a-99ab975c579d None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:49.873477 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65294f9-d774-49ed-a63a-99ab975c579d None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:49.874479 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65294f9-d774-49ed-a63a-99ab975c579d None admin] RBAC: Adding query filter params (name=member) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:51:49.874919 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65294f9-d774-49ed-a63a-99ab975c579d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:49.876432 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65294f9-d774-49ed-a63a-99ab975c579d None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:49.885109 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 111/213] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 27 18:51:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:49.887099 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169658c6-5cce-4126-901a-d8fb8850629a None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:49.887548 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169658c6-5cce-4126-901a-d8fb8850629a None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:49.887982 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169658c6-5cce-4126-901a-d8fb8850629a None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:49.889318 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 112/214] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:51:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:51:49.892061 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169658c6-5cce-4126-901a-d8fb8850629a None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:49.936618 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 103/215] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:51:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:51:49.938181 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c662a4f-972b-43b2-9699-d3abc51ea240 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:49.938472 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c662a4f-972b-43b2-9699-d3abc51ea240 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:49.938748 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c662a4f-972b-43b2-9699-d3abc51ea240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:49.958217 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-4c662a4f-972b-43b2-9699-d3abc51ea240 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:51:49.959597 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-4c662a4f-972b-43b2-9699-d3abc51ea240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:49.978283 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:50.011146 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169658c6-5cce-4126-901a-d8fb8850629a None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:50.028633 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 104/216] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:51:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:51:50.032556 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c662a4f-972b-43b2-9699-d3abc51ea240 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:50.052272 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3789b3-f5ba-4b21-8bb0-84f372b6a5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:50.053057 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3789b3-f5ba-4b21-8bb0-84f372b6a5b1 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:50.053265 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3789b3-f5ba-4b21-8bb0-84f372b6a5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:50.053538 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3789b3-f5ba-4b21-8bb0-84f372b6a5b1 None admin] PATH_INFO: `/v3/users/2a488369b4004a1f849c42acec0867b5` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:50.070867 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3789b3-f5ba-4b21-8bb0-84f372b6a5b1 None admin] RBAC: Authorizing `identity:get_user(user_id=2a488369b4004a1f849c42acec0867b5)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:50.072263 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3789b3-f5ba-4b21-8bb0-84f372b6a5b1 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:50.074104 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 113/217] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 27 18:51:49 2022] GET /identity/v3/users/2a488369b4004a1f849c42acec0867b5 => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:51:50.076995 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3789b3-f5ba-4b21-8bb0-84f372b6a5b1 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:50.122784 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:50.140496 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c662a4f-972b-43b2-9699-d3abc51ea240 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:50.176615 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55d413-6293-4c88-a11b-2b57aa714d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:50.177258 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55d413-6293-4c88-a11b-2b57aa714d69 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:50.177541 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55d413-6293-4c88-a11b-2b57aa714d69 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:50.177816 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55d413-6293-4c88-a11b-2b57aa714d69 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:50.183922 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3789b3-f5ba-4b21-8bb0-84f372b6a5b1 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:50.188022 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c55d413-6293-4c88-a11b-2b57aa714d69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:51:50.192966 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-4c55d413-6293-4c88-a11b-2b57aa714d69 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:51:50.192966 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:51:50.192966 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:51:50.192966 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:51:50.192966 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:51:50.192966 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:51:50.192966 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:51:50.192966 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:51:50.192966 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:51:50.192966 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:51:50.192966 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:51:50.192966 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:51:50.192966 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:51:50.192966 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:51:50.192966 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:51:50.192966 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:51:50.193830 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:51:50.193830 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:51:50.193830 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:51:50.193830 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:51:50.193830 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:51:50.193830 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:51:50.193830 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:51:50.193830 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:51:50.193830 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:51:50.193830 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:51:50.193830 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:51:50.193830 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:51:50.193830 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:51:50.193830 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:51:50.193830 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:51:50.193830 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:51:50.194634 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:51:50.194634 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:51:50.194634 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:51:50.194634 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:51:50.194634 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:51:50.194634 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:51:50.194634 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:51:50.194634 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:51:50.194634 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:51:50.194634 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:51:50.194634 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:51:50.194634 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:51:50.194634 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 105/218] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 27 18:51:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:51:50.195294 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55d413-6293-4c88-a11b-2b57aa714d69 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:50.211603 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:50.227380 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e3600-0b7b-4ff3-835a-60b1c331382a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:50.228061 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e3600-0b7b-4ff3-835a-60b1c331382a None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:50.228361 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e3600-0b7b-4ff3-835a-60b1c331382a None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:50.228612 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e3600-0b7b-4ff3-835a-60b1c331382a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:50.230300 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e3600-0b7b-4ff3-835a-60b1c331382a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:50.231766 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e3600-0b7b-4ff3-835a-60b1c331382a None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:50.233362 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 114/219] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:51:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:50.233362 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e3600-0b7b-4ff3-835a-60b1c331382a None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:50.309048 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55d413-6293-4c88-a11b-2b57aa714d69 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:50.336759 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e3600-0b7b-4ff3-835a-60b1c331382a None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:50.346037 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:50.348504 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7bd53e-61a3-474c-a18f-30e3a6a0bb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:50.349120 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7bd53e-61a3-474c-a18f-30e3a6a0bb4f None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:50.349365 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7bd53e-61a3-474c-a18f-30e3a6a0bb4f None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:50.349636 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7bd53e-61a3-474c-a18f-30e3a6a0bb4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:50.374482 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c323c-3c65-460d-ac28-6330ed18c434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:50.375115 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c323c-3c65-460d-ac28-6330ed18c434 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:50.375404 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c323c-3c65-460d-ac28-6330ed18c434 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:50.375700 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c323c-3c65-460d-ac28-6330ed18c434 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:50.376419 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595c323c-3c65-460d-ac28-6330ed18c434 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:51:50.376826 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595c323c-3c65-460d-ac28-6330ed18c434 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:50.378201 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595c323c-3c65-460d-ac28-6330ed18c434 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:50.387812 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 115/220] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 27 18:51:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:50.392911 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c323c-3c65-460d-ac28-6330ed18c434 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:50.423410 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7bd53e-61a3-474c-a18f-30e3a6a0bb4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:50.424918 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7bd53e-61a3-474c-a18f-30e3a6a0bb4f None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:50.440624 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:50.504735 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c323c-3c65-460d-ac28-6330ed18c434 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:50.536540 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 106/221] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 27 18:51:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:51:50.537373 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7bd53e-61a3-474c-a18f-30e3a6a0bb4f None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:50.550558 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cff485-b0ce-4c99-b1f9-9b1c6771945c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:50.551185 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cff485-b0ce-4c99-b1f9-9b1c6771945c None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:50.551471 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cff485-b0ce-4c99-b1f9-9b1c6771945c None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:50.551849 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cff485-b0ce-4c99-b1f9-9b1c6771945c None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:50.552458 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cff485-b0ce-4c99-b1f9-9b1c6771945c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:50.553942 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cff485-b0ce-4c99-b1f9-9b1c6771945c None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:50.587802 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 116/222] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Jul 27 18:51:50 2022] POST /identity/v3/users => generated 297 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:51:50.587802 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cff485-b0ce-4c99-b1f9-9b1c6771945c None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:50.622451 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:50.669567 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7bd53e-61a3-474c-a18f-30e3a6a0bb4f None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:50.686899 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:50.708647 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da61fb05-6eb8-4f22-b5a4-a27472b31cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:50.709312 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61fb05-6eb8-4f22-b5a4-a27472b31cad None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:50.709595 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61fb05-6eb8-4f22-b5a4-a27472b31cad None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:50.709891 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61fb05-6eb8-4f22-b5a4-a27472b31cad None admin] PATH_INFO: `/v3/users/a3c62bc78aff4ac69f17dd12a648d0ee` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:50.711150 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da61fb05-6eb8-4f22-b5a4-a27472b31cad None admin] RBAC: Authorizing `identity:get_user(user_id=a3c62bc78aff4ac69f17dd12a648d0ee)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:50.712654 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da61fb05-6eb8-4f22-b5a4-a27472b31cad None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:50.714403 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 107/223] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 27 18:51:50 2022] GET /identity/v3/users/a3c62bc78aff4ac69f17dd12a648d0ee => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:50.714403 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca6a38-6dee-4f3d-a30f-ce0c25ced898 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:50.715928 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca6a38-6dee-4f3d-a30f-ce0c25ced898 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:50.716141 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca6a38-6dee-4f3d-a30f-ce0c25ced898 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:50.717527 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 108/224] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:51:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:51:50.720636 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca6a38-6dee-4f3d-a30f-ce0c25ced898 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:50.735148 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cff485-b0ce-4c99-b1f9-9b1c6771945c None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:50.778853 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9945f274-d136-453e-82e0-8c1cc25ec2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:50.779984 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945f274-d136-453e-82e0-8c1cc25ec2dc None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:50.779984 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945f274-d136-453e-82e0-8c1cc25ec2dc None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:50.780170 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945f274-d136-453e-82e0-8c1cc25ec2dc None admin] PATH_INFO: `/v3/projects/fb4af7b5833b4b5b84a3c061a2fc98c8` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:50.782249 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9945f274-d136-453e-82e0-8c1cc25ec2dc None admin] RBAC: Authorizing `identity:get_project(project_id=fb4af7b5833b4b5b84a3c061a2fc98c8)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:50.782692 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9945f274-d136-453e-82e0-8c1cc25ec2dc None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:50.784433 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 117/225] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 27 18:51:50 2022] GET /identity/v3/projects/fb4af7b5833b4b5b84a3c061a2fc98c8 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:50.787850 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc016ad-8bfd-4924-88ad-07b1168b9fdd None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:50.787850 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc016ad-8bfd-4924-88ad-07b1168b9fdd None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:50.787850 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc016ad-8bfd-4924-88ad-07b1168b9fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:50.806164 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-7fc016ad-8bfd-4924-88ad-07b1168b9fdd None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:51:50.807335 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-7fc016ad-8bfd-4924-88ad-07b1168b9fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:50.847814 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca6a38-6dee-4f3d-a30f-ce0c25ced898 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:50.888308 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e1a63-9ab7-4802-a771-8f97fab7c9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:50.888954 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e1a63-9ab7-4802-a771-8f97fab7c9d7 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:50.889227 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e1a63-9ab7-4802-a771-8f97fab7c9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:50.889502 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e1a63-9ab7-4802-a771-8f97fab7c9d7 None admin] PATH_INFO: `/v3/projects/fb4af7b5833b4b5b84a3c061a2fc98c8` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:50.890650 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640e1a63-9ab7-4802-a771-8f97fab7c9d7 None admin] RBAC: Authorizing `identity:get_project(project_id=fb4af7b5833b4b5b84a3c061a2fc98c8)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:50.892143 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640e1a63-9ab7-4802-a771-8f97fab7c9d7 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:50.893724 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 118/226] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:51:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:51:50.894098 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 109/227] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 27 18:51:50 2022] GET /identity/v3/projects/fb4af7b5833b4b5b84a3c061a2fc98c8 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:50.894406 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc016ad-8bfd-4924-88ad-07b1168b9fdd None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:50.899764 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e1a63-9ab7-4802-a771-8f97fab7c9d7 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:50.926986 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:50.962391 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:51.021761 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e1a63-9ab7-4802-a771-8f97fab7c9d7 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:51.028220 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc016ad-8bfd-4924-88ad-07b1168b9fdd None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:51.066212 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553b687-1ed5-4781-9649-5d3425ce2485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:51.066450 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76297ba7-cdf9-4546-9811-6675e576523a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:51.066939 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76297ba7-cdf9-4546-9811-6675e576523a None admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:51.067219 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76297ba7-cdf9-4546-9811-6675e576523a None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:51.067490 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76297ba7-cdf9-4546-9811-6675e576523a None admin] PATH_INFO: `/v3/projects/fb4af7b5833b4b5b84a3c061a2fc98c8/users/a3c62bc78aff4ac69f17dd12a648d0ee/roles/0f4a39b061e148418413cfe647af9a34` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:51.067665 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553b687-1ed5-4781-9649-5d3425ce2485 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:51.068101 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553b687-1ed5-4781-9649-5d3425ce2485 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:51.068532 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553b687-1ed5-4781-9649-5d3425ce2485 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:51.069456 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76297ba7-cdf9-4546-9811-6675e576523a None admin] RBAC: Authorizing `identity:create_grant(project_id=fb4af7b5833b4b5b84a3c061a2fc98c8, user_id=a3c62bc78aff4ac69f17dd12a648d0ee, role_id=0f4a39b061e148418413cfe647af9a34)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:51.069595 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6553b687-1ed5-4781-9649-5d3425ce2485 None admin] RBAC: Adding query filter params (role.id=448ae448fe9a474ab1166ca18f7ac4d8, scope.project.id=fb4af7b5833b4b5b84a3c061a2fc98c8, user.id=2a488369b4004a1f849c42acec0867b5) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:51:51.070028 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6553b687-1ed5-4781-9649-5d3425ce2485 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:51.070883 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76297ba7-cdf9-4546-9811-6675e576523a None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:51.071797 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6553b687-1ed5-4781-9649-5d3425ce2485 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:51.078309 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 119/228] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 27 18:51:50 2022] GET /identity/v3/role_assignments?user.id=2a488369b4004a1f849c42acec0867b5&scope.project.id=fb4af7b5833b4b5b84a3c061a2fc98c8&role.id=448ae448fe9a474ab1166ca18f7ac4d8 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:51.079357 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553b687-1ed5-4781-9649-5d3425ce2485 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:51.095810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 110/229] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 27 18:51:50 2022] PUT /identity/v3/projects/fb4af7b5833b4b5b84a3c061a2fc98c8/users/a3c62bc78aff4ac69f17dd12a648d0ee/roles/0f4a39b061e148418413cfe647af9a34 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:51:51.198197 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:51.214866 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553b687-1ed5-4781-9649-5d3425ce2485 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:51.264972 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02794b6e-6381-4961-8172-9801ec1a5c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:51.265900 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02794b6e-6381-4961-8172-9801ec1a5c7b None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:51.266331 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02794b6e-6381-4961-8172-9801ec1a5c7b None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:51.266751 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02794b6e-6381-4961-8172-9801ec1a5c7b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:51.284790 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02794b6e-6381-4961-8172-9801ec1a5c7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:51:51.290674 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-02794b6e-6381-4961-8172-9801ec1a5c7b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:51:51.290674 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:51:51.290674 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:51:51.290674 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:51:51.290674 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:51:51.290674 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:51:51.290674 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:51:51.290674 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:51:51.290674 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:51:51.290674 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:51:51.290674 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:51:51.290674 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:51:51.290674 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:51:51.290674 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:51:51.290674 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:51:51.290674 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:51:51.291806 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:51:51.291806 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:51:51.291806 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:51:51.291806 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:51:51.291806 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:51:51.291806 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:51:51.291806 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:51:51.291806 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:51:51.291806 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:51:51.291806 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:51:51.291806 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:51:51.291806 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:51:51.291806 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:51:51.291806 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:51:51.291806 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:51:51.291806 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:51:51.292858 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:51:51.292858 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:51:51.292858 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:51:51.292858 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:51:51.292858 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:51:51.292858 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:51:51.292858 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:51:51.292858 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:51:51.292858 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:51:51.292858 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:51:51.292858 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:51:51.292858 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:51:51.294955 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 120/230] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 27 18:51:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:51:51.301335 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76297ba7-cdf9-4546-9811-6675e576523a None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:51.416992 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76297ba7-cdf9-4546-9811-6675e576523a None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:51.428246 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:51.459625 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc110f10-6324-4b48-8373-084e798a84f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:51.460172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc110f10-6324-4b48-8373-084e798a84f3 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:51.460447 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc110f10-6324-4b48-8373-084e798a84f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:51.460718 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc110f10-6324-4b48-8373-084e798a84f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:51.461446 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc110f10-6324-4b48-8373-084e798a84f3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:51:51.461747 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc110f10-6324-4b48-8373-084e798a84f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:51.463211 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc110f10-6324-4b48-8373-084e798a84f3 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:51.471960 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 111/231] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 27 18:51:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:51.477652 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02794b6e-6381-4961-8172-9801ec1a5c7b None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:51.637208 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02794b6e-6381-4961-8172-9801ec1a5c7b None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:51.685724 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291ddbc-25c2-4c9b-b3a1-342a7189be79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:51.686380 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291ddbc-25c2-4c9b-b3a1-342a7189be79 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:51.686665 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291ddbc-25c2-4c9b-b3a1-342a7189be79 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:51.686943 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291ddbc-25c2-4c9b-b3a1-342a7189be79 None admin] PATH_INFO: `/v3/users/a3c62bc78aff4ac69f17dd12a648d0ee` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:51.688228 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1291ddbc-25c2-4c9b-b3a1-342a7189be79 None admin] RBAC: Authorizing `identity:get_user(user_id=a3c62bc78aff4ac69f17dd12a648d0ee)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:51.689668 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1291ddbc-25c2-4c9b-b3a1-342a7189be79 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:51.691476 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 121/232] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 27 18:51:51 2022] GET /identity/v3/users/a3c62bc78aff4ac69f17dd12a648d0ee => generated 283 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:51.697232 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc110f10-6324-4b48-8373-084e798a84f3 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:51.871759 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc110f10-6324-4b48-8373-084e798a84f3 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:51.904523 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a648b-19a7-4257-9cf9-d5313160c902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:51.905155 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a648b-19a7-4257-9cf9-d5313160c902 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:51.905434 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a648b-19a7-4257-9cf9-d5313160c902 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:51.905702 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a648b-19a7-4257-9cf9-d5313160c902 None admin] PATH_INFO: `/v3/projects/fb4af7b5833b4b5b84a3c061a2fc98c8` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:51.906856 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8a648b-19a7-4257-9cf9-d5313160c902 None admin] RBAC: Authorizing `identity:get_project(project_id=fb4af7b5833b4b5b84a3c061a2fc98c8)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:51.908331 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8a648b-19a7-4257-9cf9-d5313160c902 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:51.909996 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 112/233] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 27 18:51:51 2022] GET /identity/v3/projects/fb4af7b5833b4b5b84a3c061a2fc98c8 => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:51.915641 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291ddbc-25c2-4c9b-b3a1-342a7189be79 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:51.935541 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:52.024953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291ddbc-25c2-4c9b-b3a1-342a7189be79 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:52.060472 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0521100a-e533-4479-977f-ecfca545ee5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:52.061155 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521100a-e533-4479-977f-ecfca545ee5c None admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:52.061436 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521100a-e533-4479-977f-ecfca545ee5c None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:52.061711 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521100a-e533-4479-977f-ecfca545ee5c None admin] PATH_INFO: `/v3/projects/fb4af7b5833b4b5b84a3c061a2fc98c8/users/a3c62bc78aff4ac69f17dd12a648d0ee/roles/8d808722e03a4591a59440f170ec672f` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:52.064085 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0521100a-e533-4479-977f-ecfca545ee5c None admin] RBAC: Authorizing `identity:create_grant(project_id=fb4af7b5833b4b5b84a3c061a2fc98c8, user_id=a3c62bc78aff4ac69f17dd12a648d0ee, role_id=8d808722e03a4591a59440f170ec672f)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:52.065529 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0521100a-e533-4479-977f-ecfca545ee5c None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:52.080424 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 122/234] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 27 18:51:51 2022] PUT /identity/v3/projects/fb4af7b5833b4b5b84a3c061a2fc98c8/users/a3c62bc78aff4ac69f17dd12a648d0ee/roles/8d808722e03a4591a59440f170ec672f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:51:53.186606 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ba730-a444-4701-9b80-3cb6c248dbf9 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:53.187150 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ba730-a444-4701-9b80-3cb6c248dbf9 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:53.187150 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ba730-a444-4701-9b80-3cb6c248dbf9 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:53.188705 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 113/235] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:51:53.193641 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d5d17-58f0-4e70-92e8-bbb73a0a2941 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:53.194032 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d5d17-58f0-4e70-92e8-bbb73a0a2941 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:53.194206 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d5d17-58f0-4e70-92e8-bbb73a0a2941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:53.212509 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-394d5d17-58f0-4e70-92e8-bbb73a0a2941 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:51:53.213683 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-394d5d17-58f0-4e70-92e8-bbb73a0a2941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:53.300558 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 123/236] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:51:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:51:53.322729 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ba730-a444-4701-9b80-3cb6c248dbf9 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:53.377727 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:53.463373 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ba730-a444-4701-9b80-3cb6c248dbf9 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:53.506877 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d3de4-ac85-4eab-b38c-30997924b365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:53.507521 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d3de4-ac85-4eab-b38c-30997924b365 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:53.507830 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d3de4-ac85-4eab-b38c-30997924b365 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:53.508101 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d3de4-ac85-4eab-b38c-30997924b365 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:53.520939 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51d3de4-ac85-4eab-b38c-30997924b365 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:51:53.524235 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-b51d3de4-ac85-4eab-b38c-30997924b365 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 18:51:53.524235 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:51:53.524235 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:51:53.524235 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:51:53.524235 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:51:53.524235 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:51:53.524235 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:51:53.524235 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:51:53.524235 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:51:53.524235 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:51:53.524235 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:51:53.524235 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:51:53.524235 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:51:53.524235 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:51:53.524235 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:51:53.524235 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:51:53.525081 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:51:53.525081 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:51:53.525081 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:51:53.525081 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:51:53.525081 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:51:53.525081 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:51:53.525081 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:51:53.525081 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:51:53.525081 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:51:53.525081 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:51:53.525081 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:51:53.525081 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:51:53.525081 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:51:53.525081 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:51:53.525081 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:51:53.525081 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:51:53.525838 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:51:53.525838 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:51:53.525838 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:51:53.525838 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:51:53.525838 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:51:53.525838 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:51:53.525838 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:51:53.525838 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:51:53.525838 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:51:53.525838 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:51:53.525838 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 18:51:53.525838 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:51:53.525838 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 114/237] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 27 18:51:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:51:53.535280 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394d5d17-58f0-4e70-92e8-bbb73a0a2941 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:53.544450 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:53.563988 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd20a6-aa71-4987-b46d-d34e3b2d4437 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:53.565020 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd20a6-aa71-4987-b46d-d34e3b2d4437 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:53.565305 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd20a6-aa71-4987-b46d-d34e3b2d4437 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:53.567006 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 115/238] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:51:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:51:53.573028 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592a33d-b5ba-4981-b3be-c129272cb4b9 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:53.573766 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592a33d-b5ba-4981-b3be-c129272cb4b9 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:53.574142 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592a33d-b5ba-4981-b3be-c129272cb4b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:53.594887 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-e592a33d-b5ba-4981-b3be-c129272cb4b9 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:51:53.596115 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-e592a33d-b5ba-4981-b3be-c129272cb4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:53.668273 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394d5d17-58f0-4e70-92e8-bbb73a0a2941 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:53.685897 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 116/239] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:51:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:51:53.687318 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7dcba0-6dad-4eea-b2c4-e82df150cc32 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:53.687604 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7dcba0-6dad-4eea-b2c4-e82df150cc32 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:53.687905 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7dcba0-6dad-4eea-b2c4-e82df150cc32 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:53.689261 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 117/240] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:51:53.697147 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c15de5-9524-4616-82da-a28879051a8f None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:53.697428 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c15de5-9524-4616-82da-a28879051a8f None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:53.697704 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c15de5-9524-4616-82da-a28879051a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:53.721263 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d06893-d3ad-4a9c-a130-f50117a2f4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:53.721805 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d06893-d3ad-4a9c-a130-f50117a2f4c5 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:53.722086 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d06893-d3ad-4a9c-a130-f50117a2f4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:53.722358 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d06893-d3ad-4a9c-a130-f50117a2f4c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:53.723077 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d06893-d3ad-4a9c-a130-f50117a2f4c5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:51:53.723381 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d06893-d3ad-4a9c-a130-f50117a2f4c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:53.724217 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-68c15de5-9524-4616-82da-a28879051a8f None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:51:53.724793 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d06893-d3ad-4a9c-a130-f50117a2f4c5 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:53.725447 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-68c15de5-9524-4616-82da-a28879051a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:53.733732 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 124/241] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 27 18:51:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:53.734538 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d06893-d3ad-4a9c-a130-f50117a2f4c5 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:53.755339 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:53.812400 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 118/242] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:51:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:51:53.813566 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c15de5-9524-4616-82da-a28879051a8f None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:53.816496 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:53.854471 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d06893-d3ad-4a9c-a130-f50117a2f4c5 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:53.890005 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953dc34-9ddf-4cb8-9536-c5db7da06241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:53.890658 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953dc34-9ddf-4cb8-9536-c5db7da06241 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:53.890937 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953dc34-9ddf-4cb8-9536-c5db7da06241 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:53.891207 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953dc34-9ddf-4cb8-9536-c5db7da06241 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:53.892899 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7953dc34-9ddf-4cb8-9536-c5db7da06241 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:53.893811 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7953dc34-9ddf-4cb8-9536-c5db7da06241 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:53.900260 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 125/243] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:51:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:53.900260 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953dc34-9ddf-4cb8-9536-c5db7da06241 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:53.927113 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c15de5-9524-4616-82da-a28879051a8f None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:53.962560 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b95f2-8836-4ec6-88a8-73cd126bbf77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:53.963253 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b95f2-8836-4ec6-88a8-73cd126bbf77 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:53.963535 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b95f2-8836-4ec6-88a8-73cd126bbf77 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:53.964531 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b95f2-8836-4ec6-88a8-73cd126bbf77 None admin] PATH_INFO: `/v3/users/f3a03536e6e24980a64a44d02cb8e797` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:53.978245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b95f2-8836-4ec6-88a8-73cd126bbf77 None admin] RBAC: Authorizing `identity:get_user(user_id=f3a03536e6e24980a64a44d02cb8e797)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:53.980041 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b95f2-8836-4ec6-88a8-73cd126bbf77 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:53.982033 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 119/244] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 27 18:51:53 2022] GET /identity/v3/users/f3a03536e6e24980a64a44d02cb8e797 => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:53.983094 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90834cc-a9f7-4684-949f-d3c7a713b063 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:53.983377 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90834cc-a9f7-4684-949f-d3c7a713b063 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:53.983721 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90834cc-a9f7-4684-949f-d3c7a713b063 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:53.985147 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 120/245] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:51:53.987298 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90834cc-a9f7-4684-949f-d3c7a713b063 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:54.007637 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:54.013592 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953dc34-9ddf-4cb8-9536-c5db7da06241 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:54.049546 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfced8e3-85e8-4e4b-a900-ed560f84cd3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:54.050208 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfced8e3-85e8-4e4b-a900-ed560f84cd3a None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:54.050473 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfced8e3-85e8-4e4b-a900-ed560f84cd3a None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:54.050731 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfced8e3-85e8-4e4b-a900-ed560f84cd3a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:54.053783 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:54.063834 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfced8e3-85e8-4e4b-a900-ed560f84cd3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:51:54.069295 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-cfced8e3-85e8-4e4b-a900-ed560f84cd3a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:51:54.069295 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:51:54.069295 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:51:54.069295 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:51:54.069295 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:51:54.069295 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:51:54.069295 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:51:54.069295 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:51:54.069295 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:51:54.069295 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:51:54.069295 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:51:54.069295 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:51:54.069295 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:51:54.069295 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:51:54.069295 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:51:54.069295 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:51:54.070382 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:51:54.070382 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:51:54.070382 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:51:54.070382 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:51:54.070382 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:51:54.070382 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:51:54.070382 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:51:54.070382 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:51:54.070382 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:51:54.070382 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:51:54.070382 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:51:54.070382 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:51:54.070382 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:51:54.070382 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:51:54.070382 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:51:54.070382 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:51:54.071170 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:51:54.071170 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:51:54.071170 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:51:54.071170 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:51:54.071170 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:51:54.071170 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:51:54.071170 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:51:54.071170 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:51:54.071170 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:51:54.071170 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:51:54.071170 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:51:54.071170 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:51:54.071170 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 126/246] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 27 18:51:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:51:54.072353 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271bb014-c28c-4960-80dc-d37612465999 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:54.072353 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271bb014-c28c-4960-80dc-d37612465999 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:54.072353 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271bb014-c28c-4960-80dc-d37612465999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:54.090252 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-271bb014-c28c-4960-80dc-d37612465999 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:51:54.091420 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-271bb014-c28c-4960-80dc-d37612465999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:54.104388 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90834cc-a9f7-4684-949f-d3c7a713b063 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:54.144707 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529f053-3d8f-4380-80b8-00a036477b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:54.145448 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529f053-3d8f-4380-80b8-00a036477b1e None admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:54.145731 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529f053-3d8f-4380-80b8-00a036477b1e None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:54.146006 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529f053-3d8f-4380-80b8-00a036477b1e None admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:54.146707 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529f053-3d8f-4380-80b8-00a036477b1e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:54.148225 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529f053-3d8f-4380-80b8-00a036477b1e None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:54.162745 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 127/247] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:51:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:51:54.163431 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271bb014-c28c-4960-80dc-d37612465999 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:54.185219 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 121/248] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Jul 27 18:51:53 2022] POST /identity/v3/users => generated 293 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:51:54.186021 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529f053-3d8f-4380-80b8-00a036477b1e None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:54.275656 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:54.305548 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529f053-3d8f-4380-80b8-00a036477b1e None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:54.320883 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271bb014-c28c-4960-80dc-d37612465999 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:54.346875 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36427349-acc3-450d-a537-80de07daa688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:54.347706 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36427349-acc3-450d-a537-80de07daa688 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:54.347995 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36427349-acc3-450d-a537-80de07daa688 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:54.348276 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36427349-acc3-450d-a537-80de07daa688 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:54.349042 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36427349-acc3-450d-a537-80de07daa688 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:51:54.350202 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36427349-acc3-450d-a537-80de07daa688 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:54.351622 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36427349-acc3-450d-a537-80de07daa688 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:54.360613 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:54.361756 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 122/249] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 27 18:51:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:54.362558 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36427349-acc3-450d-a537-80de07daa688 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:54.374211 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74001230-8651-4991-a787-c3941f6eb688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:54.374844 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74001230-8651-4991-a787-c3941f6eb688 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:54.375123 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74001230-8651-4991-a787-c3941f6eb688 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:54.375389 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74001230-8651-4991-a787-c3941f6eb688 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:54.472967 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74001230-8651-4991-a787-c3941f6eb688 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:54.474426 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74001230-8651-4991-a787-c3941f6eb688 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:54.510112 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36427349-acc3-450d-a537-80de07daa688 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:54.555282 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c47ce8d-b716-4c5c-97b3-8b3fcac50434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:54.556025 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47ce8d-b716-4c5c-97b3-8b3fcac50434 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:54.556300 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47ce8d-b716-4c5c-97b3-8b3fcac50434 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:54.556566 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47ce8d-b716-4c5c-97b3-8b3fcac50434 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:54.559313 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:54.570339 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c47ce8d-b716-4c5c-97b3-8b3fcac50434 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:51:54.577160 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-5c47ce8d-b716-4c5c-97b3-8b3fcac50434 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:51:54.577160 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:51:54.577160 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:51:54.577160 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:51:54.577160 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:51:54.577160 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:51:54.577160 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:51:54.577160 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:51:54.577160 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:51:54.577160 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:51:54.577160 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:51:54.577160 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:51:54.577160 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:51:54.577160 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:51:54.577160 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:51:54.577160 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:51:54.578033 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:51:54.578033 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:51:54.578033 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:51:54.578033 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:51:54.578033 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:51:54.578033 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:51:54.578033 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:51:54.578033 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:51:54.578033 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:51:54.578033 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:51:54.578033 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:51:54.578033 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:51:54.578033 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:51:54.578033 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:51:54.578033 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:51:54.578033 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:51:54.578811 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:51:54.578811 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:51:54.578811 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:51:54.578811 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:51:54.578811 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:51:54.578811 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:51:54.578811 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:51:54.578811 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:51:54.578811 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:51:54.578811 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:51:54.578811 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:51:54.578811 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:51:54.578811 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 123/250] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 27 18:51:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:51:54.578811 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c47ce8d-b716-4c5c-97b3-8b3fcac50434 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:54.609757 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 128/251] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 27 18:51:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:51:54.611138 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e754154-f6da-490c-892a-3ec543fecd01 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:54.611603 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e754154-f6da-490c-892a-3ec543fecd01 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:54.611974 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e754154-f6da-490c-892a-3ec543fecd01 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:54.613212 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 129/252] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:51:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:51:54.613898 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e754154-f6da-490c-892a-3ec543fecd01 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:54.643550 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:54.693535 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c47ce8d-b716-4c5c-97b3-8b3fcac50434 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:54.723194 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e754154-f6da-490c-892a-3ec543fecd01 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:54.730129 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736e7fad-1d81-48b3-8784-d6f56817cc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:54.731061 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e7fad-1d81-48b3-8784-d6f56817cc35 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:54.731533 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e7fad-1d81-48b3-8784-d6f56817cc35 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:54.732020 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e7fad-1d81-48b3-8784-d6f56817cc35 None admin] PATH_INFO: `/v3/users/a3c62bc78aff4ac69f17dd12a648d0ee` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:54.733446 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736e7fad-1d81-48b3-8784-d6f56817cc35 None admin] RBAC: Authorizing `identity:get_user(user_id=a3c62bc78aff4ac69f17dd12a648d0ee)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:54.735090 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736e7fad-1d81-48b3-8784-d6f56817cc35 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:54.737285 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 124/253] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 27 18:51:54 2022] GET /identity/v3/users/a3c62bc78aff4ac69f17dd12a648d0ee => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:54.738469 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736e7fad-1d81-48b3-8784-d6f56817cc35 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:54.766213 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560baba6-9f50-4c84-8e55-4dcfeff68d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:54.766833 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560baba6-9f50-4c84-8e55-4dcfeff68d69 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:54.767113 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560baba6-9f50-4c84-8e55-4dcfeff68d69 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:54.767642 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560baba6-9f50-4c84-8e55-4dcfeff68d69 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:54.768395 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560baba6-9f50-4c84-8e55-4dcfeff68d69 None admin] RBAC: Adding query filter params (name=member) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:51:54.768703 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560baba6-9f50-4c84-8e55-4dcfeff68d69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:54.770589 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560baba6-9f50-4c84-8e55-4dcfeff68d69 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:54.781499 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 130/254] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 27 18:51:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:54.783222 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b7a89-02ca-4bea-881a-bf54253a450f None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:54.783457 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b7a89-02ca-4bea-881a-bf54253a450f None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:54.783762 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b7a89-02ca-4bea-881a-bf54253a450f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:54.806517 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-819b7a89-02ca-4bea-881a-bf54253a450f None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:51:54.807211 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:54.807857 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-819b7a89-02ca-4bea-881a-bf54253a450f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:54.847578 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736e7fad-1d81-48b3-8784-d6f56817cc35 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:54.889555 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b97f0e0-fd52-441d-9cd9-0c6c6348e224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:54.890200 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97f0e0-fd52-441d-9cd9-0c6c6348e224 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:54.890476 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97f0e0-fd52-441d-9cd9-0c6c6348e224 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:54.890741 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97f0e0-fd52-441d-9cd9-0c6c6348e224 None admin] PATH_INFO: `/v3/projects/fb4af7b5833b4b5b84a3c061a2fc98c8` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:54.893109 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b97f0e0-fd52-441d-9cd9-0c6c6348e224 None admin] RBAC: Authorizing `identity:get_project(project_id=fb4af7b5833b4b5b84a3c061a2fc98c8)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:54.895195 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b97f0e0-fd52-441d-9cd9-0c6c6348e224 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:54.896348 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 131/255] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:51:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:51:54.897265 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b7a89-02ca-4bea-881a-bf54253a450f None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:54.897680 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 125/256] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 27 18:51:54 2022] GET /identity/v3/projects/fb4af7b5833b4b5b84a3c061a2fc98c8 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:54.898751 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b97f0e0-fd52-441d-9cd9-0c6c6348e224 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:54.918506 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:55.008135 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b7a89-02ca-4bea-881a-bf54253a450f None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:55.017221 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b97f0e0-fd52-441d-9cd9-0c6c6348e224 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:55.044523 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31802cf-2a7f-4082-b8fa-7121816048c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:55.045153 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31802cf-2a7f-4082-b8fa-7121816048c2 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:55.045435 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31802cf-2a7f-4082-b8fa-7121816048c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:55.045803 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31802cf-2a7f-4082-b8fa-7121816048c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:55.048871 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:55.054563 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568ea495-5132-4a94-9a19-f96192a919f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:55.055201 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ea495-5132-4a94-9a19-f96192a919f3 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:55.055483 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ea495-5132-4a94-9a19-f96192a919f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:55.055802 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ea495-5132-4a94-9a19-f96192a919f3 None admin] PATH_INFO: `/v3/users/2a488369b4004a1f849c42acec0867b5` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:55.057189 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568ea495-5132-4a94-9a19-f96192a919f3 None admin] RBAC: Authorizing `identity:get_user(user_id=2a488369b4004a1f849c42acec0867b5)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:55.058688 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568ea495-5132-4a94-9a19-f96192a919f3 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:55.060620 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 126/257] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 27 18:51:54 2022] GET /identity/v3/users/2a488369b4004a1f849c42acec0867b5 => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:55.061184 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568ea495-5132-4a94-9a19-f96192a919f3 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:55.124229 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31802cf-2a7f-4082-b8fa-7121816048c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:55.126024 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31802cf-2a7f-4082-b8fa-7121816048c2 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:55.145530 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:55.210994 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568ea495-5132-4a94-9a19-f96192a919f3 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:55.246999 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f2c6f4-ba12-4c6c-b0aa-441e5a0c13eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:55.247872 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2c6f4-ba12-4c6c-b0aa-441e5a0c13eb None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:55.248290 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2c6f4-ba12-4c6c-b0aa-441e5a0c13eb None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:55.248699 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2c6f4-ba12-4c6c-b0aa-441e5a0c13eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:55.249637 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f2c6f4-ba12-4c6c-b0aa-441e5a0c13eb None admin] RBAC: Adding query filter params (role.id=7cf1c5f66b514f79bd5f95c17ac73d46, scope.project.id=fb4af7b5833b4b5b84a3c061a2fc98c8, user.id=f3a03536e6e24980a64a44d02cb8e797) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:51:55.250094 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f2c6f4-ba12-4c6c-b0aa-441e5a0c13eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:55.251824 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f2c6f4-ba12-4c6c-b0aa-441e5a0c13eb None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:55.257483 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 127/258] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 27 18:51:55 2022] GET /identity/v3/role_assignments?user.id=f3a03536e6e24980a64a44d02cb8e797&scope.project.id=fb4af7b5833b4b5b84a3c061a2fc98c8&role.id=7cf1c5f66b514f79bd5f95c17ac73d46 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:55.258433 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f2c6f4-ba12-4c6c-b0aa-441e5a0c13eb None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:55.270342 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 132/259] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 27 18:51:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:51:55.274021 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31802cf-2a7f-4082-b8fa-7121816048c2 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:55.405244 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:55.449288 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f2c6f4-ba12-4c6c-b0aa-441e5a0c13eb None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:55.449880 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31802cf-2a7f-4082-b8fa-7121816048c2 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:55.476013 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:55.496005 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ed2e6-e5de-4e31-b054-d75911d4fb6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:55.496816 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ed2e6-e5de-4e31-b054-d75911d4fb6f None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:55.497099 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ed2e6-e5de-4e31-b054-d75911d4fb6f None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:55.497392 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ed2e6-e5de-4e31-b054-d75911d4fb6f None admin] PATH_INFO: `/v3/projects/fb4af7b5833b4b5b84a3c061a2fc98c8` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:55.498750 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ed2e6-e5de-4e31-b054-d75911d4fb6f None admin] RBAC: Authorizing `identity:get_project(project_id=fb4af7b5833b4b5b84a3c061a2fc98c8)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:55.499611 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eac1cd-2a82-4c4e-97d6-8fc98bce12d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:55.500239 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ed2e6-e5de-4e31-b054-d75911d4fb6f None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:55.500773 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eac1cd-2a82-4c4e-97d6-8fc98bce12d2 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:55.501242 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eac1cd-2a82-4c4e-97d6-8fc98bce12d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:55.501698 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eac1cd-2a82-4c4e-97d6-8fc98bce12d2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:55.501920 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 133/260] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 27 18:51:55 2022] GET /identity/v3/projects/fb4af7b5833b4b5b84a3c061a2fc98c8 => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:55.502975 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ed2e6-e5de-4e31-b054-d75911d4fb6f None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:55.520923 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eac1cd-2a82-4c4e-97d6-8fc98bce12d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:51:55.539901 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-25eac1cd-2a82-4c4e-97d6-8fc98bce12d2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:51:55.539901 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:51:55.539901 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:51:55.539901 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:51:55.539901 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:51:55.539901 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:51:55.539901 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:51:55.539901 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:51:55.539901 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:51:55.539901 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:51:55.539901 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:51:55.539901 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:51:55.539901 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:51:55.539901 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:51:55.539901 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:51:55.539901 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:51:55.540836 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:51:55.540836 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:51:55.540836 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:51:55.540836 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:51:55.540836 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:51:55.540836 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:51:55.540836 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:51:55.540836 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:51:55.540836 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:51:55.540836 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:51:55.540836 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:51:55.540836 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:51:55.540836 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:51:55.540836 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:51:55.540836 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:51:55.540836 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:51:55.541614 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:51:55.541614 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:51:55.541614 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:51:55.541614 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:51:55.541614 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:51:55.541614 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:51:55.541614 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:51:55.541614 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:51:55.541614 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:51:55.541614 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:51:55.541614 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:51:55.541614 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:51:55.548736 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 128/261] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 27 18:51:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:51:55.548736 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eac1cd-2a82-4c4e-97d6-8fc98bce12d2 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:55.668322 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ed2e6-e5de-4e31-b054-d75911d4fb6f None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:55.731148 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eac1cd-2a82-4c4e-97d6-8fc98bce12d2 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:55.734362 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a21ae1-4bb1-45a6-be75-64d1478903c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:55.735016 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a21ae1-4bb1-45a6-be75-64d1478903c4 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:55.735297 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a21ae1-4bb1-45a6-be75-64d1478903c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:55.735566 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a21ae1-4bb1-45a6-be75-64d1478903c4 None admin] PATH_INFO: `/v3/projects/fb4af7b5833b4b5b84a3c061a2fc98c8` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:55.737207 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a21ae1-4bb1-45a6-be75-64d1478903c4 None admin] RBAC: Authorizing `identity:get_project(project_id=fb4af7b5833b4b5b84a3c061a2fc98c8)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:55.738659 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a21ae1-4bb1-45a6-be75-64d1478903c4 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:55.741379 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 134/262] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 27 18:51:55 2022] GET /identity/v3/projects/fb4af7b5833b4b5b84a3c061a2fc98c8 => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:55.745987 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a21ae1-4bb1-45a6-be75-64d1478903c4 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:55.771767 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:55.793597 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c301d2d-a78e-4f51-ba74-1229ee85c027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:55.794274 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c301d2d-a78e-4f51-ba74-1229ee85c027 None admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:55.794553 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c301d2d-a78e-4f51-ba74-1229ee85c027 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:55.794825 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c301d2d-a78e-4f51-ba74-1229ee85c027 None admin] PATH_INFO: `/v3/projects/fb4af7b5833b4b5b84a3c061a2fc98c8/users/2a488369b4004a1f849c42acec0867b5/roles/448ae448fe9a474ab1166ca18f7ac4d8` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:55.797435 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c301d2d-a78e-4f51-ba74-1229ee85c027 None admin] RBAC: Authorizing `identity:create_grant(project_id=fb4af7b5833b4b5b84a3c061a2fc98c8, user_id=2a488369b4004a1f849c42acec0867b5, role_id=448ae448fe9a474ab1166ca18f7ac4d8)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:55.798873 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c301d2d-a78e-4f51-ba74-1229ee85c027 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:55.829777 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 129/263] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 27 18:51:55 2022] PUT /identity/v3/projects/fb4af7b5833b4b5b84a3c061a2fc98c8/users/2a488369b4004a1f849c42acec0867b5/roles/448ae448fe9a474ab1166ca18f7ac4d8 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:51:55.830621 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c301d2d-a78e-4f51-ba74-1229ee85c027 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:55.862881 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:55.958528 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a21ae1-4bb1-45a6-be75-64d1478903c4 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:56.030386 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c067be9a-c0e6-494f-af52-558edbb9346d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:56.031024 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067be9a-c0e6-494f-af52-558edbb9346d None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:56.031305 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067be9a-c0e6-494f-af52-558edbb9346d None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:56.031580 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067be9a-c0e6-494f-af52-558edbb9346d None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:56.032926 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c067be9a-c0e6-494f-af52-558edbb9346d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:51:56.033235 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c067be9a-c0e6-494f-af52-558edbb9346d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:56.034663 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c067be9a-c0e6-494f-af52-558edbb9346d None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:56.054850 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 135/264] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 27 18:51:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:56.060755 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c067be9a-c0e6-494f-af52-558edbb9346d None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:56.074766 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c301d2d-a78e-4f51-ba74-1229ee85c027 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:56.189008 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64994a9-e597-4aa5-af7e-78de86fbb29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:56.189648 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64994a9-e597-4aa5-af7e-78de86fbb29d None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:56.189933 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64994a9-e597-4aa5-af7e-78de86fbb29d None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:56.190211 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64994a9-e597-4aa5-af7e-78de86fbb29d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:56.191016 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64994a9-e597-4aa5-af7e-78de86fbb29d None admin] RBAC: Adding query filter params (role.id=0f4a39b061e148418413cfe647af9a34, scope.project.id=fb4af7b5833b4b5b84a3c061a2fc98c8, user.id=a3c62bc78aff4ac69f17dd12a648d0ee) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:51:56.191337 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64994a9-e597-4aa5-af7e-78de86fbb29d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:56.192868 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64994a9-e597-4aa5-af7e-78de86fbb29d None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:56.192972 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c067be9a-c0e6-494f-af52-558edbb9346d None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:56.206822 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 130/265] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 27 18:51:55 2022] GET /identity/v3/role_assignments?user.id=a3c62bc78aff4ac69f17dd12a648d0ee&scope.project.id=fb4af7b5833b4b5b84a3c061a2fc98c8&role.id=0f4a39b061e148418413cfe647af9a34 => generated 608 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:56.222705 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:56.242290 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a80998-1aff-4d31-9023-41b332ce5326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:56.242961 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a80998-1aff-4d31-9023-41b332ce5326 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:56.243247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a80998-1aff-4d31-9023-41b332ce5326 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:56.243527 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a80998-1aff-4d31-9023-41b332ce5326 None admin] PATH_INFO: `/v3/users/a3c62bc78aff4ac69f17dd12a648d0ee` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:56.248699 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a80998-1aff-4d31-9023-41b332ce5326 None admin] RBAC: Authorizing `identity:get_user(user_id=a3c62bc78aff4ac69f17dd12a648d0ee)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:56.250182 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a80998-1aff-4d31-9023-41b332ce5326 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:56.252218 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 136/266] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 27 18:51:56 2022] GET /identity/v3/users/a3c62bc78aff4ac69f17dd12a648d0ee => generated 283 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:56.257670 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64994a9-e597-4aa5-af7e-78de86fbb29d None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:56.340146 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:56.411298 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64994a9-e597-4aa5-af7e-78de86fbb29d None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:56.452813 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de364d4d-3651-4dda-86d0-1589d609b0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:56.453769 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de364d4d-3651-4dda-86d0-1589d609b0f3 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:56.454263 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de364d4d-3651-4dda-86d0-1589d609b0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:56.454768 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de364d4d-3651-4dda-86d0-1589d609b0f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:56.535741 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de364d4d-3651-4dda-86d0-1589d609b0f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:56.535741 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de364d4d-3651-4dda-86d0-1589d609b0f3 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:56.585512 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:56.651724 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 131/267] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 27 18:51:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:51:56.657520 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a80998-1aff-4d31-9023-41b332ce5326 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:56.684721 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1f91f-a89d-4549-a69d-625aed506c43 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:56.685000 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1f91f-a89d-4549-a69d-625aed506c43 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:56.685304 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1f91f-a89d-4549-a69d-625aed506c43 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:56.686652 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 132/268] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:51:56.691876 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d91663-caec-4ab1-a530-f889d7b964a7 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:56.692283 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d91663-caec-4ab1-a530-f889d7b964a7 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:56.692658 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d91663-caec-4ab1-a530-f889d7b964a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:56.715893 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-07d91663-caec-4ab1-a530-f889d7b964a7 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:51:56.721255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-07d91663-caec-4ab1-a530-f889d7b964a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:56.825468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 133/269] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:51:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:51:56.833848 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a80998-1aff-4d31-9023-41b332ce5326 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:56.848853 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d91663-caec-4ab1-a530-f889d7b964a7 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:56.878597 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b470f8-1ff4-4ff4-87f9-25c5725bf46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:56.879483 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b470f8-1ff4-4ff4-87f9-25c5725bf46f None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:56.879483 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b470f8-1ff4-4ff4-87f9-25c5725bf46f None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:56.883083 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b470f8-1ff4-4ff4-87f9-25c5725bf46f None admin] PATH_INFO: `/v3/projects/fb4af7b5833b4b5b84a3c061a2fc98c8` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:56.883614 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b470f8-1ff4-4ff4-87f9-25c5725bf46f None admin] RBAC: Authorizing `identity:get_project(project_id=fb4af7b5833b4b5b84a3c061a2fc98c8)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:56.885187 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b470f8-1ff4-4ff4-87f9-25c5725bf46f None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:56.887409 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 137/270] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 27 18:51:56 2022] GET /identity/v3/projects/fb4af7b5833b4b5b84a3c061a2fc98c8 => generated 302 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:56.894592 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b470f8-1ff4-4ff4-87f9-25c5725bf46f None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:56.980719 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:56.982671 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:57.012478 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d91663-caec-4ab1-a530-f889d7b964a7 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:57.033134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b470f8-1ff4-4ff4-87f9-25c5725bf46f None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:57.058133 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905d49de-c7c2-4e0d-9e06-dc3353e51cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:57.059840 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d49de-c7c2-4e0d-9e06-dc3353e51cca None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:57.060325 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d49de-c7c2-4e0d-9e06-dc3353e51cca None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:57.061048 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d49de-c7c2-4e0d-9e06-dc3353e51cca None admin] PATH_INFO: `/v3/roles/member` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:57.070050 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeea221-f60d-4767-a027-02e6949edb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:57.070680 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeea221-f60d-4767-a027-02e6949edb81 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:57.070961 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeea221-f60d-4767-a027-02e6949edb81 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:57.071498 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeea221-f60d-4767-a027-02e6949edb81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:57.072411 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeea221-f60d-4767-a027-02e6949edb81 None admin] RBAC: Adding query filter params (role.id=8d808722e03a4591a59440f170ec672f, scope.project.id=fb4af7b5833b4b5b84a3c061a2fc98c8, user.id=a3c62bc78aff4ac69f17dd12a648d0ee) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:51:57.072723 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeea221-f60d-4767-a027-02e6949edb81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:57.075011 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeea221-f60d-4767-a027-02e6949edb81 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:57.075661 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905d49de-c7c2-4e0d-9e06-dc3353e51cca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:51:57.087725 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 138/271] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 27 18:51:56 2022] GET /identity/v3/role_assignments?user.id=a3c62bc78aff4ac69f17dd12a648d0ee&scope.project.id=fb4af7b5833b4b5b84a3c061a2fc98c8&role.id=8d808722e03a4591a59440f170ec672f => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:57.087725 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aea1a5-f883-46ad-bed9-71da889d073c None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:57.087725 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aea1a5-f883-46ad-bed9-71da889d073c None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:57.087725 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aea1a5-f883-46ad-bed9-71da889d073c None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:57.087725 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 139/272] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:51:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:51:57.089402 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-905d49de-c7c2-4e0d-9e06-dc3353e51cca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:51:57.089402 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:51:57.089402 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:51:57.089402 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:51:57.089402 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:51:57.089402 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:51:57.089402 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:51:57.089402 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:51:57.089402 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:51:57.089402 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:51:57.089402 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:51:57.089402 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:51:57.089402 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:51:57.089402 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:51:57.089402 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:51:57.089402 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:51:57.090221 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:51:57.090221 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:51:57.090221 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:51:57.090221 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:51:57.090221 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:51:57.090221 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:51:57.090221 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:51:57.090221 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:51:57.090221 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:51:57.090221 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:51:57.090221 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:51:57.090221 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:51:57.090221 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:51:57.090221 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:51:57.090221 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:51:57.090221 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:51:57.090979 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:51:57.090979 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:51:57.090979 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:51:57.090979 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:51:57.090979 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:51:57.090979 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:51:57.090979 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:51:57.090979 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:51:57.090979 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:51:57.090979 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:51:57.090979 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:51:57.090979 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:51:57.091560 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e074a9b-1374-4488-b774-7e80c011d32e None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:57.091560 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e074a9b-1374-4488-b774-7e80c011d32e None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:57.091560 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e074a9b-1374-4488-b774-7e80c011d32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:57.093871 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 134/273] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 27 18:51:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:51:57.101078 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905d49de-c7c2-4e0d-9e06-dc3353e51cca None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:57.114304 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-6e074a9b-1374-4488-b774-7e80c011d32e None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:51:57.115529 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-6e074a9b-1374-4488-b774-7e80c011d32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:57.262796 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 140/274] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:51:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:51:57.282117 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905d49de-c7c2-4e0d-9e06-dc3353e51cca None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:57.299178 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e074a9b-1374-4488-b774-7e80c011d32e None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:57.320855 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31dbf6b-060f-4796-b4c1-f7c30f602b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:57.321080 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31dbf6b-060f-4796-b4c1-f7c30f602b98 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:57.321158 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31dbf6b-060f-4796-b4c1-f7c30f602b98 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:57.321430 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31dbf6b-060f-4796-b4c1-f7c30f602b98 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:57.322149 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31dbf6b-060f-4796-b4c1-f7c30f602b98 None admin] RBAC: Adding query filter params (name=member) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:51:57.322505 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31dbf6b-060f-4796-b4c1-f7c30f602b98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:57.325200 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31dbf6b-060f-4796-b4c1-f7c30f602b98 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:57.331495 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:57.339736 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 135/275] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 27 18:51:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:57.342058 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31dbf6b-060f-4796-b4c1-f7c30f602b98 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:57.367664 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:57.434813 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e074a9b-1374-4488-b774-7e80c011d32e None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:57.459287 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31dbf6b-060f-4796-b4c1-f7c30f602b98 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:57.481153 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18d6f86-01d3-4037-8956-8d15bc4edbe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:57.481798 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d6f86-01d3-4037-8956-8d15bc4edbe1 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:57.482074 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d6f86-01d3-4037-8956-8d15bc4edbe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:57.482345 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d6f86-01d3-4037-8956-8d15bc4edbe1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:57.483484 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18d6f86-01d3-4037-8956-8d15bc4edbe1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:57.484991 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18d6f86-01d3-4037-8956-8d15bc4edbe1 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:57.487828 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 141/276] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:51:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:51:57.493204 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18d6f86-01d3-4037-8956-8d15bc4edbe1 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:57.516304 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab724eb-e752-4da2-a311-f26ed4b96186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:57.516785 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab724eb-e752-4da2-a311-f26ed4b96186 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:57.517062 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab724eb-e752-4da2-a311-f26ed4b96186 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:57.517332 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab724eb-e752-4da2-a311-f26ed4b96186 None admin] PATH_INFO: `/v3/users/0398f3131c2645ee926208ebc85e765d` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:57.543780 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab724eb-e752-4da2-a311-f26ed4b96186 None admin] RBAC: Authorizing `identity:get_user(user_id=0398f3131c2645ee926208ebc85e765d)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:57.545774 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab724eb-e752-4da2-a311-f26ed4b96186 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:57.549167 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 136/277] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 27 18:51:57 2022] GET /identity/v3/users/0398f3131c2645ee926208ebc85e765d => generated 293 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:57.559081 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab724eb-e752-4da2-a311-f26ed4b96186 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:57.627740 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18d6f86-01d3-4037-8956-8d15bc4edbe1 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:57.642741 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:57.644265 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:57.673184 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8959b9cf-f620-47cf-b9b1-59609266ab3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:57.675060 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8959b9cf-f620-47cf-b9b1-59609266ab3f None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:57.676084 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8959b9cf-f620-47cf-b9b1-59609266ab3f None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:57.676566 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8959b9cf-f620-47cf-b9b1-59609266ab3f None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:57.677737 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8959b9cf-f620-47cf-b9b1-59609266ab3f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:57.680174 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8959b9cf-f620-47cf-b9b1-59609266ab3f None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:57.699120 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab724eb-e752-4da2-a311-f26ed4b96186 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:57.711219 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 142/278] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Jul 27 18:51:57 2022] POST /identity/v3/users => generated 293 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:51:57.713462 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50043a6e-3307-4be4-bef7-44a710bf19eb None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:57.713788 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50043a6e-3307-4be4-bef7-44a710bf19eb None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:57.714532 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50043a6e-3307-4be4-bef7-44a710bf19eb None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:57.716024 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 143/279] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:51:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:51:57.725700 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145c26b-5c55-4782-b5a1-ece5a3b9318b None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:57.726039 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145c26b-5c55-4782-b5a1-ece5a3b9318b None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:57.726271 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145c26b-5c55-4782-b5a1-ece5a3b9318b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:57.746539 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-f145c26b-5c55-4782-b5a1-ece5a3b9318b None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:51:57.747761 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-f145c26b-5c55-4782-b5a1-ece5a3b9318b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:57.754964 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d925406-9ba5-4859-a724-843b11a6011e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:57.756667 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d925406-9ba5-4859-a724-843b11a6011e None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:57.757183 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d925406-9ba5-4859-a724-843b11a6011e None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:57.757655 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d925406-9ba5-4859-a724-843b11a6011e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:57.759210 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d925406-9ba5-4859-a724-843b11a6011e None admin] RBAC: Adding query filter params (role.id=448ae448fe9a474ab1166ca18f7ac4d8, user.id=0398f3131c2645ee926208ebc85e765d, scope.system=all) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:51:57.760244 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d925406-9ba5-4859-a724-843b11a6011e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:57.762576 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d925406-9ba5-4859-a724-843b11a6011e None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:57.776519 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 137/280] 10.222.0.20 () {56 vars in 1308 bytes} [Wed Jul 27 18:51:57 2022] GET /identity/v3/role_assignments?user.id=0398f3131c2645ee926208ebc85e765d&scope.system=all&role.id=448ae448fe9a474ab1166ca18f7ac4d8 => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:57.839873 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 144/281] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:51:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:51:57.859285 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d925406-9ba5-4859-a724-843b11a6011e None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:57.973385 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d925406-9ba5-4859-a724-843b11a6011e None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:57.998121 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:58.011610 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c67d13-b1d6-42d6-adee-8d2b052adb85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:58.012272 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c67d13-b1d6-42d6-adee-8d2b052adb85 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:58.013222 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c67d13-b1d6-42d6-adee-8d2b052adb85 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:58.013222 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c67d13-b1d6-42d6-adee-8d2b052adb85 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:58.023788 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c67d13-b1d6-42d6-adee-8d2b052adb85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:51:58.029224 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-b5c67d13-b1d6-42d6-adee-8d2b052adb85 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 18:51:58.029224 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:51:58.029224 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:51:58.029224 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:51:58.029224 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:51:58.029224 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:51:58.029224 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:51:58.029224 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:51:58.029224 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:51:58.029224 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:51:58.029224 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:51:58.029224 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:51:58.029224 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:51:58.029224 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:51:58.029224 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:51:58.029224 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:51:58.030106 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:51:58.030106 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:51:58.030106 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:51:58.030106 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:51:58.030106 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:51:58.030106 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:51:58.030106 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:51:58.030106 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:51:58.030106 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:51:58.030106 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:51:58.030106 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:51:58.030106 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:51:58.030106 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:51:58.030106 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:51:58.030106 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:51:58.030106 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:51:58.030898 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:51:58.030898 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:51:58.030898 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:51:58.030898 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:51:58.030898 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:51:58.030898 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:51:58.030898 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:51:58.030898 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:51:58.030898 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:51:58.030898 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:51:58.030898 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 18:51:58.030898 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:51:58.030898 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 138/282] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 27 18:51:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:51:58.036474 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145c26b-5c55-4782-b5a1-ece5a3b9318b None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:58.140220 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:58.144009 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145c26b-5c55-4782-b5a1-ece5a3b9318b None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:58.183307 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a370cc-99ed-4595-a8a8-5e2b87c06579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:58.183958 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a370cc-99ed-4595-a8a8-5e2b87c06579 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:58.184231 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a370cc-99ed-4595-a8a8-5e2b87c06579 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:58.184496 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a370cc-99ed-4595-a8a8-5e2b87c06579 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:58.185205 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a370cc-99ed-4595-a8a8-5e2b87c06579 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:51:58.185500 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a370cc-99ed-4595-a8a8-5e2b87c06579 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:58.186847 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a370cc-99ed-4595-a8a8-5e2b87c06579 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:58.196011 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 145/283] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 27 18:51:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:58.202614 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c67d13-b1d6-42d6-adee-8d2b052adb85 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:58.314781 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c67d13-b1d6-42d6-adee-8d2b052adb85 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:58.356644 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e3553-0f66-4ed6-8b3f-29b9439caadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:58.357286 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e3553-0f66-4ed6-8b3f-29b9439caadc None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:58.357564 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e3553-0f66-4ed6-8b3f-29b9439caadc None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:58.357835 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e3553-0f66-4ed6-8b3f-29b9439caadc None admin] PATH_INFO: `/v3/users/f3a03536e6e24980a64a44d02cb8e797` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:58.360455 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19e3553-0f66-4ed6-8b3f-29b9439caadc None admin] RBAC: Authorizing `identity:get_user(user_id=f3a03536e6e24980a64a44d02cb8e797)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:58.362268 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19e3553-0f66-4ed6-8b3f-29b9439caadc None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:58.364260 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 139/284] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 27 18:51:58 2022] GET /identity/v3/users/f3a03536e6e24980a64a44d02cb8e797 => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:51:58.369567 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a370cc-99ed-4595-a8a8-5e2b87c06579 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:58.482759 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a370cc-99ed-4595-a8a8-5e2b87c06579 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:58.524448 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd4f23-8d5c-4681-a732-2d92b2c7456b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:58.525514 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd4f23-8d5c-4681-a732-2d92b2c7456b None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:58.525994 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd4f23-8d5c-4681-a732-2d92b2c7456b None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:58.526511 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd4f23-8d5c-4681-a732-2d92b2c7456b None admin] PATH_INFO: `/v3/projects/fb4af7b5833b4b5b84a3c061a2fc98c8` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:58.527947 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdd4f23-8d5c-4681-a732-2d92b2c7456b None admin] RBAC: Authorizing `identity:get_project(project_id=fb4af7b5833b4b5b84a3c061a2fc98c8)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:58.529578 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdd4f23-8d5c-4681-a732-2d92b2c7456b None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:58.535791 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 146/285] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 27 18:51:58 2022] GET /identity/v3/projects/fb4af7b5833b4b5b84a3c061a2fc98c8 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:58.537512 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e3553-0f66-4ed6-8b3f-29b9439caadc None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:58.595480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b346a67-c1b0-47ae-9778-cdd896a03e4b None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:58.595775 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b346a67-c1b0-47ae-9778-cdd896a03e4b None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:58.595995 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b346a67-c1b0-47ae-9778-cdd896a03e4b None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:58.597333 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 147/286] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:51:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:51:58.602260 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b442c-3a3b-42c2-bc99-d6c74fc43dfc None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:58.602542 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b442c-3a3b-42c2-bc99-d6c74fc43dfc None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:58.602815 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b442c-3a3b-42c2-bc99-d6c74fc43dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:58.621771 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-fc0b442c-3a3b-42c2-bc99-d6c74fc43dfc None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:51:58.622947 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-fc0b442c-3a3b-42c2-bc99-d6c74fc43dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:51:58.640035 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:58.653298 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:58.717277 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e3553-0f66-4ed6-8b3f-29b9439caadc None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:58.738241 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 148/287] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:51:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:51:58.767576 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b442c-3a3b-42c2-bc99-d6c74fc43dfc None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:58.769764 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d70bb6f-9d34-4bc6-af03-fa32b15f5b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:58.770556 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70bb6f-9d34-4bc6-af03-fa32b15f5b99 None admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:58.770840 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70bb6f-9d34-4bc6-af03-fa32b15f5b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:58.771114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70bb6f-9d34-4bc6-af03-fa32b15f5b99 None admin] PATH_INFO: `/v3/projects/fb4af7b5833b4b5b84a3c061a2fc98c8/users/f3a03536e6e24980a64a44d02cb8e797/roles/7cf1c5f66b514f79bd5f95c17ac73d46` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:58.773122 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d70bb6f-9d34-4bc6-af03-fa32b15f5b99 None admin] RBAC: Authorizing `identity:create_grant(project_id=fb4af7b5833b4b5b84a3c061a2fc98c8, user_id=f3a03536e6e24980a64a44d02cb8e797, role_id=7cf1c5f66b514f79bd5f95c17ac73d46)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:58.774556 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d70bb6f-9d34-4bc6-af03-fa32b15f5b99 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:58.796443 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 140/288] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 27 18:51:58 2022] PUT /identity/v3/projects/fb4af7b5833b4b5b84a3c061a2fc98c8/users/f3a03536e6e24980a64a44d02cb8e797/roles/7cf1c5f66b514f79bd5f95c17ac73d46 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:51:58.918199 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b442c-3a3b-42c2-bc99-d6c74fc43dfc None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:58.966258 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3722b853-d970-4195-b136-f1d34fb5dce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:58.966917 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722b853-d970-4195-b136-f1d34fb5dce6 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:58.967258 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722b853-d970-4195-b136-f1d34fb5dce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:58.967537 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722b853-d970-4195-b136-f1d34fb5dce6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:58.978641 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3722b853-d970-4195-b136-f1d34fb5dce6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:51:58.983601 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-3722b853-d970-4195-b136-f1d34fb5dce6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:51:58.983601 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:51:58.983601 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:51:58.983601 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:51:58.983601 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:51:58.983601 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:51:58.983601 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:51:58.983601 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:51:58.983601 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:51:58.983601 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:51:58.983601 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:51:58.983601 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:51:58.983601 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:51:58.983601 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:51:58.983601 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:51:58.983601 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:51:58.984480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:51:58.984480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:51:58.984480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:51:58.984480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:51:58.984480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:51:58.984480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:51:58.984480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:51:58.984480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:51:58.984480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:51:58.984480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:51:58.984480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:51:58.984480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:51:58.984480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:51:58.984480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:51:58.984480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:51:58.984480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:51:58.985252 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:51:58.985252 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:51:58.985252 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:51:58.985252 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:51:58.985252 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:51:58.985252 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:51:58.985252 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:51:58.985252 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:51:58.985252 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:51:58.985252 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:51:58.985252 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:51:58.985252 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:51:58.985252 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 149/289] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 27 18:51:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:51:58.991135 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d70bb6f-9d34-4bc6-af03-fa32b15f5b99 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:59.107797 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d70bb6f-9d34-4bc6-af03-fa32b15f5b99 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:59.119772 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:59.149443 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c94efb5-0a3e-460d-b88c-8f107d281d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:59.150059 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94efb5-0a3e-460d-b88c-8f107d281d3a None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:59.150376 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94efb5-0a3e-460d-b88c-8f107d281d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:59.150654 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94efb5-0a3e-460d-b88c-8f107d281d3a None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:59.151963 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c94efb5-0a3e-460d-b88c-8f107d281d3a None admin] RBAC: Adding query filter params (name=member) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:51:59.152270 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c94efb5-0a3e-460d-b88c-8f107d281d3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:59.153651 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c94efb5-0a3e-460d-b88c-8f107d281d3a None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:59.162223 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 141/290] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 27 18:51:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:51:59.168901 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3722b853-d970-4195-b136-f1d34fb5dce6 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:59.195725 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:59.359437 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3722b853-d970-4195-b136-f1d34fb5dce6 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:59.410261 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d130d-5994-4f0d-80d4-8fb5ce2b15b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:59.410904 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d130d-5994-4f0d-80d4-8fb5ce2b15b6 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:59.411183 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d130d-5994-4f0d-80d4-8fb5ce2b15b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:59.411455 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d130d-5994-4f0d-80d4-8fb5ce2b15b6 None admin] PATH_INFO: `/v3/users/2a488369b4004a1f849c42acec0867b5` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:59.416531 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d130d-5994-4f0d-80d4-8fb5ce2b15b6 None admin] RBAC: Authorizing `identity:get_user(user_id=2a488369b4004a1f849c42acec0867b5)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:59.418637 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d130d-5994-4f0d-80d4-8fb5ce2b15b6 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:59.420387 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 150/291] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 27 18:51:59 2022] GET /identity/v3/users/2a488369b4004a1f849c42acec0867b5 => generated 297 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:51:59.426124 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c94efb5-0a3e-460d-b88c-8f107d281d3a None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:59.572132 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c94efb5-0a3e-460d-b88c-8f107d281d3a None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:59.623225 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4bb302-d7fa-44b7-b6d7-047fb404f6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:59.623867 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4bb302-d7fa-44b7-b6d7-047fb404f6c9 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:59.624149 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4bb302-d7fa-44b7-b6d7-047fb404f6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:59.624420 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4bb302-d7fa-44b7-b6d7-047fb404f6c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:59.680518 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:59.721742 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4bb302-d7fa-44b7-b6d7-047fb404f6c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:59.723221 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4bb302-d7fa-44b7-b6d7-047fb404f6c9 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:59.840819 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 142/292] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 27 18:51:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:51:59.848749 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d130d-5994-4f0d-80d4-8fb5ce2b15b6 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:59.953695 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:59.969904 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d130d-5994-4f0d-80d4-8fb5ce2b15b6 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:00.020384 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b8b27-7f93-4b55-b683-641e1133b335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:00.021041 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b8b27-7f93-4b55-b683-641e1133b335 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:00.021326 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b8b27-7f93-4b55-b683-641e1133b335 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:00.021603 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b8b27-7f93-4b55-b683-641e1133b335 None admin] PATH_INFO: `/v3/projects/fb4af7b5833b4b5b84a3c061a2fc98c8` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:00.022797 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160b8b27-7f93-4b55-b683-641e1133b335 None admin] RBAC: Authorizing `identity:get_project(project_id=fb4af7b5833b4b5b84a3c061a2fc98c8)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:00.024258 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160b8b27-7f93-4b55-b683-641e1133b335 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:00.025916 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 151/293] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 27 18:51:59 2022] GET /identity/v3/projects/fb4af7b5833b4b5b84a3c061a2fc98c8 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:00.032541 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4bb302-d7fa-44b7-b6d7-047fb404f6c9 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:00.117204 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:00.156509 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4bb302-d7fa-44b7-b6d7-047fb404f6c9 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:00.198826 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a5020-8d88-4a66-9fd3-93ac92cc8f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:00.199445 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a5020-8d88-4a66-9fd3-93ac92cc8f1e None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:00.199749 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a5020-8d88-4a66-9fd3-93ac92cc8f1e None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:00.200025 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a5020-8d88-4a66-9fd3-93ac92cc8f1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:00.200817 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a5020-8d88-4a66-9fd3-93ac92cc8f1e None admin] RBAC: Adding query filter params (role.id=448ae448fe9a474ab1166ca18f7ac4d8, scope.project.id=fb4af7b5833b4b5b84a3c061a2fc98c8, user.id=2a488369b4004a1f849c42acec0867b5) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:00.201125 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a5020-8d88-4a66-9fd3-93ac92cc8f1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:00.202561 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a5020-8d88-4a66-9fd3-93ac92cc8f1e None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:00.209081 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 143/294] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 27 18:52:00 2022] GET /identity/v3/role_assignments?user.id=2a488369b4004a1f849c42acec0867b5&scope.project.id=fb4af7b5833b4b5b84a3c061a2fc98c8&role.id=448ae448fe9a474ab1166ca18f7ac4d8 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:00.509180 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c3f2b-fc4d-4f22-a591-60fb6944c7ae None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:00.509519 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c3f2b-fc4d-4f22-a591-60fb6944c7ae None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:00.509718 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c3f2b-fc4d-4f22-a591-60fb6944c7ae None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:00.511572 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 152/295] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:52:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:52:00.517082 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e6117-5fbc-4a16-a65d-c7ff9853cf21 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:00.517369 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e6117-5fbc-4a16-a65d-c7ff9853cf21 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:00.517530 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce304ae-49da-4687-b830-ee6501a577a0 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:00.517697 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e6117-5fbc-4a16-a65d-c7ff9853cf21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:00.517847 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce304ae-49da-4687-b830-ee6501a577a0 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:00.518014 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce304ae-49da-4687-b830-ee6501a577a0 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:00.521157 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 153/296] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:52:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:52:00.534955 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced4303-8f50-43ac-9643-6d586e939343 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:00.535503 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced4303-8f50-43ac-9643-6d586e939343 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:00.536022 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced4303-8f50-43ac-9643-6d586e939343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:00.544549 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-7c1e6117-5fbc-4a16-a65d-c7ff9853cf21 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:00.546028 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-7c1e6117-5fbc-4a16-a65d-c7ff9853cf21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:00.558679 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-2ced4303-8f50-43ac-9643-6d586e939343 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:00.560198 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-2ced4303-8f50-43ac-9643-6d586e939343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:00.633060 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 144/297] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:52:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:52:00.654240 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 154/298] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:52:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:52:00.663772 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1e6117-5fbc-4a16-a65d-c7ff9853cf21 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:00.676874 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced4303-8f50-43ac-9643-6d586e939343 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:00.734038 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:00.770728 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:00.771485 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1e6117-5fbc-4a16-a65d-c7ff9853cf21 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:00.785407 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced4303-8f50-43ac-9643-6d586e939343 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:00.811349 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13282765-3b9e-4088-91c2-cca3dd620012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:00.812044 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13282765-3b9e-4088-91c2-cca3dd620012 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:00.812321 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13282765-3b9e-4088-91c2-cca3dd620012 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:00.812582 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13282765-3b9e-4088-91c2-cca3dd620012 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:00.823374 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ed65e-8e8a-47ba-b35e-9af9542bbbc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:00.823876 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13282765-3b9e-4088-91c2-cca3dd620012 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:52:00.824482 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ed65e-8e8a-47ba-b35e-9af9542bbbc1 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:00.824911 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ed65e-8e8a-47ba-b35e-9af9542bbbc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:00.825366 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ed65e-8e8a-47ba-b35e-9af9542bbbc1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:00.826606 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7ed65e-8e8a-47ba-b35e-9af9542bbbc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:00.828094 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7ed65e-8e8a-47ba-b35e-9af9542bbbc1 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:00.829853 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 155/299] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:52:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:52:00.832959 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-13282765-3b9e-4088-91c2-cca3dd620012 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:52:00.832959 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:00.832959 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:00.832959 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:00.832959 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:00.832959 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:00.832959 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:00.832959 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:00.832959 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:00.832959 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:00.832959 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:00.832959 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:00.832959 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:52:00.832959 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:52:00.832959 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:52:00.832959 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:52:00.833806 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:52:00.833806 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:52:00.833806 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:52:00.833806 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:52:00.833806 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:00.833806 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:00.833806 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:00.833806 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:00.833806 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:00.833806 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:00.833806 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:00.833806 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:00.833806 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:00.833806 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:00.833806 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:00.833806 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:00.834625 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:00.834625 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:00.834625 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:00.834625 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:00.834625 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:52:00.834625 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:52:00.834625 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:52:00.834625 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:52:00.834625 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:52:00.834625 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:52:00.834625 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:52:00.834625 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:00.835510 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234846c4-7693-4910-8de7-51d6b02eb183 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:00.835977 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234846c4-7693-4910-8de7-51d6b02eb183 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:00.836253 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234846c4-7693-4910-8de7-51d6b02eb183 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:00.837711 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 156/300] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:52:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:52:00.842702 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234846c4-7693-4910-8de7-51d6b02eb183 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:00.843459 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 145/301] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 27 18:52:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:00.844569 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13282765-3b9e-4088-91c2-cca3dd620012 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:00.951191 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13282765-3b9e-4088-91c2-cca3dd620012 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:00.953527 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234846c4-7693-4910-8de7-51d6b02eb183 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:00.978456 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:00.988722 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ecbf29-efe4-4cc9-b0a3-19c2a03e2abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:00.989343 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ecbf29-efe4-4cc9-b0a3-19c2a03e2abe None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:00.989626 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ecbf29-efe4-4cc9-b0a3-19c2a03e2abe None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:00.989903 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ecbf29-efe4-4cc9-b0a3-19c2a03e2abe None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:00.990623 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ecbf29-efe4-4cc9-b0a3-19c2a03e2abe None admin] RBAC: Adding query filter params (name=member) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:00.990962 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ecbf29-efe4-4cc9-b0a3-19c2a03e2abe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:00.991530 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17dc89-2a9c-4951-95ae-cc2ffab9d864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:00.992182 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17dc89-2a9c-4951-95ae-cc2ffab9d864 None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:00.992353 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ecbf29-efe4-4cc9-b0a3-19c2a03e2abe None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:00.992444 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17dc89-2a9c-4951-95ae-cc2ffab9d864 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:00.992717 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17dc89-2a9c-4951-95ae-cc2ffab9d864 None admin] PATH_INFO: `/v3/groups` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:00.993374 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d17dc89-2a9c-4951-95ae-cc2ffab9d864 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:00.994821 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d17dc89-2a9c-4951-95ae-cc2ffab9d864 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:01.000885 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 146/302] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 27 18:52:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:01.006456 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab999ac0-1ea6-4eb7-bbb8-690a87c741da None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:01.006456 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab999ac0-1ea6-4eb7-bbb8-690a87c741da None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:01.006456 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab999ac0-1ea6-4eb7-bbb8-690a87c741da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:01.016886 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 157/303] 10.222.0.20 () {60 vars in 1134 bytes} [Wed Jul 27 18:52:00 2022] POST /identity/v3/groups => generated 229 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:52:01.017631 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17dc89-2a9c-4951-95ae-cc2ffab9d864 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:01.034578 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-ab999ac0-1ea6-4eb7-bbb8-690a87c741da None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:01.036206 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-ab999ac0-1ea6-4eb7-bbb8-690a87c741da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:01.043785 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:01.128625 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 147/304] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:52:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:52:01.152626 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab999ac0-1ea6-4eb7-bbb8-690a87c741da None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:01.172182 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17dc89-2a9c-4951-95ae-cc2ffab9d864 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:01.221751 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656d76b-de4e-496a-9ce3-b74ed0baed75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:01.222461 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656d76b-de4e-496a-9ce3-b74ed0baed75 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:01.222780 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656d76b-de4e-496a-9ce3-b74ed0baed75 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:01.223068 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656d76b-de4e-496a-9ce3-b74ed0baed75 None admin] PATH_INFO: `/v3/users/0398f3131c2645ee926208ebc85e765d` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:01.224298 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f656d76b-de4e-496a-9ce3-b74ed0baed75 None admin] RBAC: Authorizing `identity:get_user(user_id=0398f3131c2645ee926208ebc85e765d)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:01.225748 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f656d76b-de4e-496a-9ce3-b74ed0baed75 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:01.227728 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 158/305] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 27 18:52:01 2022] GET /identity/v3/users/0398f3131c2645ee926208ebc85e765d => generated 293 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:01.234734 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656d76b-de4e-496a-9ce3-b74ed0baed75 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:01.279957 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab999ac0-1ea6-4eb7-bbb8-690a87c741da None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:01.299139 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:01.318092 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab051d-67a5-4848-8503-457a9b05ea35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:01.318970 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab051d-67a5-4848-8503-457a9b05ea35 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:01.319165 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab051d-67a5-4848-8503-457a9b05ea35 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:01.319431 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab051d-67a5-4848-8503-457a9b05ea35 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:01.330822 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ab051d-67a5-4848-8503-457a9b05ea35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:52:01.335586 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:01.335844 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-02ab051d-67a5-4848-8503-457a9b05ea35 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 18:52:01.335844 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:01.335844 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:01.335844 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:01.335844 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:01.335844 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:01.335844 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:01.335844 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:01.335844 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:01.335844 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:01.335844 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:01.335844 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:01.335844 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:52:01.335844 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:52:01.335844 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:52:01.335844 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:52:01.336734 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:52:01.336734 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:52:01.336734 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:52:01.336734 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:52:01.336734 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:01.336734 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:01.336734 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:01.336734 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:01.336734 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:01.336734 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:01.336734 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:01.336734 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:01.336734 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:01.336734 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:01.336734 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:01.336734 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:01.340528 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:01.340528 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:01.340528 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:01.340528 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:01.340528 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:52:01.340528 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:52:01.340528 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:52:01.340528 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:52:01.340528 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:52:01.340528 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:52:01.340528 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 18:52:01.340528 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:01.340528 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 148/306] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 27 18:52:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:52:01.340528 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085966ed-7ce1-4393-98db-82107f7fdc34 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:01.344673 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085966ed-7ce1-4393-98db-82107f7fdc34 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:01.344673 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085966ed-7ce1-4393-98db-82107f7fdc34 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:01.344673 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 149/307] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:52:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:52:01.344673 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085966ed-7ce1-4393-98db-82107f7fdc34 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:01.362389 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656d76b-de4e-496a-9ce3-b74ed0baed75 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:01.395427 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3956afe7-0233-4659-93ac-faa50246c055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:01.396109 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956afe7-0233-4659-93ac-faa50246c055 None admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:01.396386 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956afe7-0233-4659-93ac-faa50246c055 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:01.396649 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956afe7-0233-4659-93ac-faa50246c055 None admin] PATH_INFO: `/v3/system/users/0398f3131c2645ee926208ebc85e765d/roles/448ae448fe9a474ab1166ca18f7ac4d8` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:01.398081 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3956afe7-0233-4659-93ac-faa50246c055 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0398f3131c2645ee926208ebc85e765d, role_id=448ae448fe9a474ab1166ca18f7ac4d8)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:01.399443 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3956afe7-0233-4659-93ac-faa50246c055 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:01.410195 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 159/308] 10.222.0.20 () {58 vars in 1334 bytes} [Wed Jul 27 18:52:01 2022] PUT /identity/v3/system/users/0398f3131c2645ee926208ebc85e765d/roles/448ae448fe9a474ab1166ca18f7ac4d8 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:01.417360 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b609275-a1b0-4b6e-b28d-983da02afefd None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:01.417683 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b609275-a1b0-4b6e-b28d-983da02afefd None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:01.417917 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b609275-a1b0-4b6e-b28d-983da02afefd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:01.437811 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-1b609275-a1b0-4b6e-b28d-983da02afefd None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:01.439045 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-1b609275-a1b0-4b6e-b28d-983da02afefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:01.470218 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085966ed-7ce1-4393-98db-82107f7fdc34 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:01.515766 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ef55c-06f1-48ea-8305-c7b4e02be7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:01.517223 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ef55c-06f1-48ea-8305-c7b4e02be7f2 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:01.517831 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ef55c-06f1-48ea-8305-c7b4e02be7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:01.518665 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ef55c-06f1-48ea-8305-c7b4e02be7f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:01.520016 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993ef55c-06f1-48ea-8305-c7b4e02be7f2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:01.520611 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993ef55c-06f1-48ea-8305-c7b4e02be7f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:01.522999 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993ef55c-06f1-48ea-8305-c7b4e02be7f2 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:01.531716 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 160/309] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:52:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:52:01.543557 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 150/310] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 27 18:52:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:52:01.551725 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b609275-a1b0-4b6e-b28d-983da02afefd None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:01.552742 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ef55c-06f1-48ea-8305-c7b4e02be7f2 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:01.604847 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:01.654838 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:01.681794 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b609275-a1b0-4b6e-b28d-983da02afefd None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:01.689171 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ef55c-06f1-48ea-8305-c7b4e02be7f2 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:01.727323 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ae49b-aef5-40d4-aed5-de35b48642cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:01.728258 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ae49b-aef5-40d4-aed5-de35b48642cc None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:01.728636 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ae49b-aef5-40d4-aed5-de35b48642cc None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:01.728836 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630aa63-8eac-413e-92d1-30cb10739374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:01.729135 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ae49b-aef5-40d4-aed5-de35b48642cc None admin] PATH_INFO: `/v3/users/6867f61485ae4f88a6e1d16833be6c80` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:01.729816 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630aa63-8eac-413e-92d1-30cb10739374 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:01.730260 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630aa63-8eac-413e-92d1-30cb10739374 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:01.730675 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630aa63-8eac-413e-92d1-30cb10739374 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:01.743120 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5630aa63-8eac-413e-92d1-30cb10739374 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:52:01.746941 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7ae49b-aef5-40d4-aed5-de35b48642cc None admin] RBAC: Authorizing `identity:get_user(user_id=6867f61485ae4f88a6e1d16833be6c80)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:01.748520 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7ae49b-aef5-40d4-aed5-de35b48642cc None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:01.749824 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-5630aa63-8eac-413e-92d1-30cb10739374 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 18:52:01.749824 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:01.749824 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:01.749824 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:01.749824 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:01.749824 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:01.749824 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:01.749824 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:01.749824 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:01.749824 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:01.749824 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:01.749824 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:01.749824 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:52:01.749824 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:52:01.749824 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:52:01.749824 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:52:01.750752 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:52:01.750752 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:52:01.750752 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:52:01.750752 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:52:01.750752 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:01.750752 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:01.750752 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:01.750752 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:01.750752 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:01.750752 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:01.750752 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:01.750752 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:01.750752 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:01.750752 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:01.750752 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:01.750752 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:01.751538 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:01.751538 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:01.751538 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:01.751538 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:01.751538 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:52:01.751538 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:52:01.751538 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:52:01.751538 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:52:01.751538 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:52:01.751538 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:52:01.751538 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 18:52:01.751538 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:01.752164 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 161/311] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 27 18:52:01 2022] GET /identity/v3/users/6867f61485ae4f88a6e1d16833be6c80 => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:01.753746 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 151/312] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 27 18:52:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:01.756466 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ae49b-aef5-40d4-aed5-de35b48642cc None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:01.759297 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630aa63-8eac-413e-92d1-30cb10739374 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:01.868498 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ae49b-aef5-40d4-aed5-de35b48642cc None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:01.877246 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:01.880357 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630aa63-8eac-413e-92d1-30cb10739374 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:01.917124 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7cee8c-11f9-443c-b65e-c49620091aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:01.917784 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7cee8c-11f9-443c-b65e-c49620091aab None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:01.918058 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7cee8c-11f9-443c-b65e-c49620091aab None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:01.918326 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7cee8c-11f9-443c-b65e-c49620091aab None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:01.918709 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4297fd9-5159-4c3e-ac46-f9e6a0131c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:01.919079 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7cee8c-11f9-443c-b65e-c49620091aab None admin] RBAC: Adding query filter params (name=reader) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:01.919380 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7cee8c-11f9-443c-b65e-c49620091aab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:01.920016 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4297fd9-5159-4c3e-ac46-f9e6a0131c91 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:01.920491 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4297fd9-5159-4c3e-ac46-f9e6a0131c91 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:01.920765 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7cee8c-11f9-443c-b65e-c49620091aab None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:01.921151 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4297fd9-5159-4c3e-ac46-f9e6a0131c91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:01.922430 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4297fd9-5159-4c3e-ac46-f9e6a0131c91 None admin] RBAC: Adding query filter params (role.id=7cf1c5f66b514f79bd5f95c17ac73d46, user.id=6867f61485ae4f88a6e1d16833be6c80, scope.system=all) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:01.923364 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4297fd9-5159-4c3e-ac46-f9e6a0131c91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:01.925106 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4297fd9-5159-4c3e-ac46-f9e6a0131c91 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:01.927842 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:01.930625 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 152/313] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 27 18:52:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:52:01.934472 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 162/314] 10.222.0.20 () {56 vars in 1308 bytes} [Wed Jul 27 18:52:01 2022] GET /identity/v3/role_assignments?user.id=6867f61485ae4f88a6e1d16833be6c80&scope.system=all&role.id=7cf1c5f66b514f79bd5f95c17ac73d46 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:01.939942 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7cee8c-11f9-443c-b65e-c49620091aab None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:02.050752 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7cee8c-11f9-443c-b65e-c49620091aab None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:02.088333 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf025e57-8f37-4406-8d95-df19acbab2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:02.089262 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf025e57-8f37-4406-8d95-df19acbab2ea None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:02.089689 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf025e57-8f37-4406-8d95-df19acbab2ea None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:02.090131 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf025e57-8f37-4406-8d95-df19acbab2ea None admin] PATH_INFO: `/v3/users/f3a03536e6e24980a64a44d02cb8e797` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:02.091458 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf025e57-8f37-4406-8d95-df19acbab2ea None admin] RBAC: Authorizing `identity:get_user(user_id=f3a03536e6e24980a64a44d02cb8e797)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:02.093180 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf025e57-8f37-4406-8d95-df19acbab2ea None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:02.095216 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 153/315] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 27 18:52:01 2022] GET /identity/v3/users/f3a03536e6e24980a64a44d02cb8e797 => generated 297 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:02.100873 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4297fd9-5159-4c3e-ac46-f9e6a0131c91 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:02.205953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4297fd9-5159-4c3e-ac46-f9e6a0131c91 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:02.246347 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e145e428-f7a6-47cd-af9c-e1e69db4d8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:02.246974 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145e428-f7a6-47cd-af9c-e1e69db4d8d7 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:02.247255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145e428-f7a6-47cd-af9c-e1e69db4d8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:02.247530 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145e428-f7a6-47cd-af9c-e1e69db4d8d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:02.316391 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:02.320520 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e145e428-f7a6-47cd-af9c-e1e69db4d8d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:02.322091 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e145e428-f7a6-47cd-af9c-e1e69db4d8d7 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:02.427194 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 163/316] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 27 18:52:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:52:02.433021 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf025e57-8f37-4406-8d95-df19acbab2ea None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:02.467930 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:02.539697 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf025e57-8f37-4406-8d95-df19acbab2ea None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:02.576442 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6b6d2d-9316-4e37-983f-f67e84e6ddde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:02.577086 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b6d2d-9316-4e37-983f-f67e84e6ddde None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:02.577371 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b6d2d-9316-4e37-983f-f67e84e6ddde None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:02.577631 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b6d2d-9316-4e37-983f-f67e84e6ddde None admin] PATH_INFO: `/v3/projects/fb4af7b5833b4b5b84a3c061a2fc98c8` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:02.578783 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6b6d2d-9316-4e37-983f-f67e84e6ddde None admin] RBAC: Authorizing `identity:get_project(project_id=fb4af7b5833b4b5b84a3c061a2fc98c8)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:02.580261 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6b6d2d-9316-4e37-983f-f67e84e6ddde None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:02.582259 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 154/317] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 27 18:52:02 2022] GET /identity/v3/projects/fb4af7b5833b4b5b84a3c061a2fc98c8 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:02.590801 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e145e428-f7a6-47cd-af9c-e1e69db4d8d7 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:02.696469 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:02.701009 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e145e428-f7a6-47cd-af9c-e1e69db4d8d7 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:02.736890 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552715b4-094c-4ab9-be0b-12814f7e6f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:02.737430 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552715b4-094c-4ab9-be0b-12814f7e6f41 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:02.737714 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552715b4-094c-4ab9-be0b-12814f7e6f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:02.737989 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552715b4-094c-4ab9-be0b-12814f7e6f41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:02.738774 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552715b4-094c-4ab9-be0b-12814f7e6f41 None admin] RBAC: Adding query filter params (role.id=7cf1c5f66b514f79bd5f95c17ac73d46, scope.project.id=fb4af7b5833b4b5b84a3c061a2fc98c8, user.id=f3a03536e6e24980a64a44d02cb8e797) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:02.739084 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552715b4-094c-4ab9-be0b-12814f7e6f41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:02.740542 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552715b4-094c-4ab9-be0b-12814f7e6f41 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:02.747259 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 164/318] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 27 18:52:02 2022] GET /identity/v3/role_assignments?user.id=f3a03536e6e24980a64a44d02cb8e797&scope.project.id=fb4af7b5833b4b5b84a3c061a2fc98c8&role.id=7cf1c5f66b514f79bd5f95c17ac73d46 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:03.224224 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b66920-b3c3-45d9-900a-48aaad002be9 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:03.224782 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b66920-b3c3-45d9-900a-48aaad002be9 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:03.224782 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b66920-b3c3-45d9-900a-48aaad002be9 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:03.226252 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 155/319] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:52:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:52:03.231751 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363cfa7a-c8a7-4063-aaf0-f405b918cb62 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:03.232227 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363cfa7a-c8a7-4063-aaf0-f405b918cb62 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:03.232303 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363cfa7a-c8a7-4063-aaf0-f405b918cb62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:03.250784 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-363cfa7a-c8a7-4063-aaf0-f405b918cb62 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:03.251995 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-363cfa7a-c8a7-4063-aaf0-f405b918cb62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:03.319728 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 165/320] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:52:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:52:03.341894 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b66920-b3c3-45d9-900a-48aaad002be9 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:03.439892 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:03.446006 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b66920-b3c3-45d9-900a-48aaad002be9 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:03.460737 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798cbeb-9efe-4213-a4fc-81f9649426ff None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:03.461023 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798cbeb-9efe-4213-a4fc-81f9649426ff None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:03.461379 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798cbeb-9efe-4213-a4fc-81f9649426ff None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:03.463053 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 166/321] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:52:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:52:03.468804 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a27c4e-4bb5-415f-8a69-1a7f175e655c None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:03.469162 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a27c4e-4bb5-415f-8a69-1a7f175e655c None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:03.469508 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a27c4e-4bb5-415f-8a69-1a7f175e655c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:03.480825 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f0b4ef-2d76-422d-b73c-ab661da6d1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:03.481401 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0b4ef-2d76-422d-b73c-ab661da6d1ea None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:03.481680 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0b4ef-2d76-422d-b73c-ab661da6d1ea None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:03.481953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0b4ef-2d76-422d-b73c-ab661da6d1ea None admin] PATH_INFO: `/v3/domains/default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:03.483148 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f0b4ef-2d76-422d-b73c-ab661da6d1ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:03.484608 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f0b4ef-2d76-422d-b73c-ab661da6d1ea None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:03.486445 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 156/322] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:52:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:03.490376 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-b5a27c4e-4bb5-415f-8a69-1a7f175e655c None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:03.491743 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-b5a27c4e-4bb5-415f-8a69-1a7f175e655c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:03.491902 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f0b4ef-2d76-422d-b73c-ab661da6d1ea None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:03.572586 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 167/323] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:52:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:52:03.596277 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a27c4e-4bb5-415f-8a69-1a7f175e655c None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:03.601618 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f0b4ef-2d76-422d-b73c-ab661da6d1ea None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:03.619294 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:03.640623 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac0885-eb42-4a36-9f26-0d7e35016013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:03.641237 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac0885-eb42-4a36-9f26-0d7e35016013 None admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:03.641516 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac0885-eb42-4a36-9f26-0d7e35016013 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:03.641801 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac0885-eb42-4a36-9f26-0d7e35016013 None admin] PATH_INFO: `/v3/groups` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:03.642614 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aac0885-eb42-4a36-9f26-0d7e35016013 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:03.644199 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aac0885-eb42-4a36-9f26-0d7e35016013 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:03.662559 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 157/324] 10.222.0.20 () {60 vars in 1134 bytes} [Wed Jul 27 18:52:03 2022] POST /identity/v3/groups => generated 226 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:52:03.707549 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a27c4e-4bb5-415f-8a69-1a7f175e655c None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:03.745296 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71094915-1d45-43e7-8d7a-bcdd3a867a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:03.745877 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71094915-1d45-43e7-8d7a-bcdd3a867a26 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:03.746155 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71094915-1d45-43e7-8d7a-bcdd3a867a26 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:03.746425 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71094915-1d45-43e7-8d7a-bcdd3a867a26 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:03.757897 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71094915-1d45-43e7-8d7a-bcdd3a867a26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:52:03.763537 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-71094915-1d45-43e7-8d7a-bcdd3a867a26 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:52:03.763537 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:03.763537 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:03.763537 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:03.763537 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:03.763537 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:03.763537 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:03.763537 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:03.763537 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:03.763537 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:03.763537 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:03.763537 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:03.763537 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:52:03.763537 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:52:03.763537 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:52:03.763537 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:52:03.764443 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:52:03.764443 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:52:03.764443 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:52:03.764443 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:52:03.764443 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:03.764443 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:03.764443 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:03.764443 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:03.764443 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:03.764443 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:03.764443 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:03.764443 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:03.764443 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:03.764443 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:03.764443 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:03.764443 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:03.765219 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:03.765219 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:03.765219 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:03.765219 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:03.765219 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:52:03.765219 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:52:03.765219 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:52:03.765219 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:52:03.765219 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:52:03.765219 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:52:03.765219 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:52:03.765219 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:03.765219 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 168/325] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 27 18:52:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:52:03.771019 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac0885-eb42-4a36-9f26-0d7e35016013 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:03.801970 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:03.881655 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac0885-eb42-4a36-9f26-0d7e35016013 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:03.918249 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea7b1b-6728-491d-853c-2505db1b9128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:03.919122 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea7b1b-6728-491d-853c-2505db1b9128 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:03.919403 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea7b1b-6728-491d-853c-2505db1b9128 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:03.919677 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea7b1b-6728-491d-853c-2505db1b9128 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:03.920434 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eea7b1b-6728-491d-853c-2505db1b9128 None admin] RBAC: Adding query filter params (name=member) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:03.920741 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eea7b1b-6728-491d-853c-2505db1b9128 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:03.922172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eea7b1b-6728-491d-853c-2505db1b9128 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:03.933222 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 158/326] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 27 18:52:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:03.940630 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71094915-1d45-43e7-8d7a-bcdd3a867a26 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:03.956258 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53eeacd-1dbd-496f-953a-5c611e241011 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:03.956617 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53eeacd-1dbd-496f-953a-5c611e241011 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:03.957041 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53eeacd-1dbd-496f-953a-5c611e241011 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:03.958781 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 159/327] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:52:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:52:03.965545 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6af00-1f88-4627-afb2-501df8644cf7 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:03.966013 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6af00-1f88-4627-afb2-501df8644cf7 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:03.966421 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6af00-1f88-4627-afb2-501df8644cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:03.985400 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-9bb6af00-1f88-4627-afb2-501df8644cf7 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:03.987085 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-9bb6af00-1f88-4627-afb2-501df8644cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:04.051013 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:04.074082 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71094915-1d45-43e7-8d7a-bcdd3a867a26 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:04.078905 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 160/328] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:52:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:52:04.101444 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb6af00-1f88-4627-afb2-501df8644cf7 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:04.117445 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca18bd-6b53-4fb1-bfa1-908b26d5a956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:04.118232 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca18bd-6b53-4fb1-bfa1-908b26d5a956 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:04.118559 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca18bd-6b53-4fb1-bfa1-908b26d5a956 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:04.118831 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca18bd-6b53-4fb1-bfa1-908b26d5a956 None admin] PATH_INFO: `/v3/users/0398f3131c2645ee926208ebc85e765d` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:04.120521 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daca18bd-6b53-4fb1-bfa1-908b26d5a956 None admin] RBAC: Authorizing `identity:get_user(user_id=0398f3131c2645ee926208ebc85e765d)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:04.122385 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daca18bd-6b53-4fb1-bfa1-908b26d5a956 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:04.123459 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:04.124293 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 169/329] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 27 18:52:03 2022] GET /identity/v3/users/0398f3131c2645ee926208ebc85e765d => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:04.130468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca18bd-6b53-4fb1-bfa1-908b26d5a956 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:04.243325 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb6af00-1f88-4627-afb2-501df8644cf7 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:04.262663 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca18bd-6b53-4fb1-bfa1-908b26d5a956 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:04.286819 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9208b8b-0734-4991-9e82-5fabf3e2f2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:04.287901 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9208b8b-0734-4991-9e82-5fabf3e2f2ae None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:04.288378 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9208b8b-0734-4991-9e82-5fabf3e2f2ae None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:04.288983 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9208b8b-0734-4991-9e82-5fabf3e2f2ae None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:04.303524 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3262c3-3b1f-4225-beb3-d63138006588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:04.303929 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9208b8b-0734-4991-9e82-5fabf3e2f2ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:52:04.304144 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3262c3-3b1f-4225-beb3-d63138006588 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:04.304428 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3262c3-3b1f-4225-beb3-d63138006588 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:04.304701 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3262c3-3b1f-4225-beb3-d63138006588 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:04.305547 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3262c3-3b1f-4225-beb3-d63138006588 None admin] RBAC: Adding query filter params (role.id=448ae448fe9a474ab1166ca18f7ac4d8, user.id=0398f3131c2645ee926208ebc85e765d, scope.system=all) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:04.305861 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3262c3-3b1f-4225-beb3-d63138006588 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:04.307281 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3262c3-3b1f-4225-beb3-d63138006588 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:04.310672 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-c9208b8b-0734-4991-9e82-5fabf3e2f2ae None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 18:52:04.310672 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:04.310672 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:04.310672 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:04.310672 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:04.310672 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:04.310672 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:04.310672 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:04.310672 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:04.310672 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:04.310672 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:04.310672 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:04.310672 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:52:04.310672 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:52:04.310672 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:52:04.310672 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:52:04.311505 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:52:04.311505 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:52:04.311505 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:52:04.311505 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:52:04.311505 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:04.311505 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:04.311505 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:04.311505 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:04.311505 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:04.311505 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:04.311505 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:04.311505 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:04.311505 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:04.311505 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:04.311505 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:04.311505 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:04.312336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:04.312336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:04.312336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:04.312336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:04.312336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:52:04.312336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:52:04.312336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:52:04.312336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:52:04.312336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:52:04.312336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:52:04.312336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 18:52:04.312336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:04.315023 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 161/330] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 27 18:52:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:52:04.326657 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 170/331] 10.222.0.20 () {56 vars in 1308 bytes} [Wed Jul 27 18:52:04 2022] GET /identity/v3/role_assignments?user.id=0398f3131c2645ee926208ebc85e765d&scope.system=all&role.id=448ae448fe9a474ab1166ca18f7ac4d8 => generated 510 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:04.326890 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9208b8b-0734-4991-9e82-5fabf3e2f2ae None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:04.436488 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:04.458980 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9208b8b-0734-4991-9e82-5fabf3e2f2ae None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:04.496721 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5bba8c-ea9b-4cee-8ade-b6c3eaf6235a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:04.497584 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5bba8c-ea9b-4cee-8ade-b6c3eaf6235a None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:04.498033 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5bba8c-ea9b-4cee-8ade-b6c3eaf6235a None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:04.498448 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5bba8c-ea9b-4cee-8ade-b6c3eaf6235a None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:04.499319 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5bba8c-ea9b-4cee-8ade-b6c3eaf6235a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:04.499821 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5bba8c-ea9b-4cee-8ade-b6c3eaf6235a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:04.501368 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5bba8c-ea9b-4cee-8ade-b6c3eaf6235a None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:04.511556 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 162/332] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 27 18:52:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:04.516990 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3262c3-3b1f-4225-beb3-d63138006588 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:04.534370 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:04.633499 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3262c3-3b1f-4225-beb3-d63138006588 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:04.674503 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e676f40-af9e-4370-ab5c-753c323ddf07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:04.675413 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e676f40-af9e-4370-ab5c-753c323ddf07 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:04.675865 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e676f40-af9e-4370-ab5c-753c323ddf07 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:04.676279 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e676f40-af9e-4370-ab5c-753c323ddf07 None admin] PATH_INFO: `/v3/users/6867f61485ae4f88a6e1d16833be6c80` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:04.677605 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e676f40-af9e-4370-ab5c-753c323ddf07 None admin] RBAC: Authorizing `identity:get_user(user_id=6867f61485ae4f88a6e1d16833be6c80)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:04.679161 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e676f40-af9e-4370-ab5c-753c323ddf07 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:04.681281 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 171/333] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 27 18:52:04 2022] GET /identity/v3/users/6867f61485ae4f88a6e1d16833be6c80 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:52:04.687278 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5bba8c-ea9b-4cee-8ade-b6c3eaf6235a None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:04.818653 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5bba8c-ea9b-4cee-8ade-b6c3eaf6235a None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:04.861495 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8439ba96-67f9-428c-b262-6d72ae9aa01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:04.862236 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8439ba96-67f9-428c-b262-6d72ae9aa01f None admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:04.862525 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8439ba96-67f9-428c-b262-6d72ae9aa01f None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:04.862799 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8439ba96-67f9-428c-b262-6d72ae9aa01f None admin] PATH_INFO: `/v3/system/users/6867f61485ae4f88a6e1d16833be6c80/roles/7cf1c5f66b514f79bd5f95c17ac73d46` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:04.866264 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8439ba96-67f9-428c-b262-6d72ae9aa01f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=6867f61485ae4f88a6e1d16833be6c80, role_id=7cf1c5f66b514f79bd5f95c17ac73d46)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:04.867637 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8439ba96-67f9-428c-b262-6d72ae9aa01f None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:04.885170 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 163/334] 10.222.0.20 () {58 vars in 1334 bytes} [Wed Jul 27 18:52:04 2022] PUT /identity/v3/system/users/6867f61485ae4f88a6e1d16833be6c80/roles/7cf1c5f66b514f79bd5f95c17ac73d46 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:06.174682 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f362e-992f-4abe-b2c2-ce7e10f547e0 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:06.175217 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f362e-992f-4abe-b2c2-ce7e10f547e0 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:06.175217 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f362e-992f-4abe-b2c2-ce7e10f547e0 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:06.176879 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 172/335] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:52:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:52:06.182288 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e669ae-3ea3-4438-a875-d31ea8151ce0 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:06.182723 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e669ae-3ea3-4438-a875-d31ea8151ce0 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:06.182896 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e669ae-3ea3-4438-a875-d31ea8151ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:06.195559 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:06.208539 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-a9e669ae-3ea3-4438-a875-d31ea8151ce0 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:06.211163 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-a9e669ae-3ea3-4438-a875-d31ea8151ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:06.308593 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 164/336] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:52:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:52:06.347416 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f362e-992f-4abe-b2c2-ce7e10f547e0 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:06.434747 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:06.465978 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f362e-992f-4abe-b2c2-ce7e10f547e0 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:06.501838 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1097a58-63a1-49f0-bcf5-6e9c9c5e847d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:06.502488 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1097a58-63a1-49f0-bcf5-6e9c9c5e847d None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:06.502766 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1097a58-63a1-49f0-bcf5-6e9c9c5e847d None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:06.503042 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1097a58-63a1-49f0-bcf5-6e9c9c5e847d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:06.517297 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1097a58-63a1-49f0-bcf5-6e9c9c5e847d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:52:06.522699 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-a1097a58-63a1-49f0-bcf5-6e9c9c5e847d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:52:06.522699 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:06.522699 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:06.522699 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:06.522699 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:06.522699 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:06.522699 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:06.522699 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:06.522699 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:06.522699 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:06.522699 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:06.522699 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:06.522699 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:52:06.522699 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:52:06.522699 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:52:06.522699 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:52:06.523562 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:52:06.523562 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:52:06.523562 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:52:06.523562 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:52:06.523562 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:06.523562 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:06.523562 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:06.523562 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:06.523562 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:06.523562 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:06.523562 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:06.523562 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:06.523562 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:06.523562 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:06.523562 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:06.523562 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:06.524381 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:06.524381 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:06.524381 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:06.524381 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:06.524381 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:52:06.524381 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:52:06.524381 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:52:06.524381 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:52:06.524381 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:52:06.524381 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:52:06.524381 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:52:06.524381 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:06.524381 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 173/337] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 27 18:52:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:06.533518 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e4c89-015b-4799-8e3f-29a4f008a073 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:06.533518 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e4c89-015b-4799-8e3f-29a4f008a073 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:06.533518 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e4c89-015b-4799-8e3f-29a4f008a073 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:06.533518 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 165/338] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:52:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:52:06.533851 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1097a58-63a1-49f0-bcf5-6e9c9c5e847d None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:06.557824 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d287b-4af8-4ea8-9f42-c4eafa5241cf None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:06.558427 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d287b-4af8-4ea8-9f42-c4eafa5241cf None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:06.558919 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d287b-4af8-4ea8-9f42-c4eafa5241cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:06.587325 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-dd0d287b-4af8-4ea8-9f42-c4eafa5241cf None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:06.589242 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-dd0d287b-4af8-4ea8-9f42-c4eafa5241cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:06.684969 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1097a58-63a1-49f0-bcf5-6e9c9c5e847d None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:06.726790 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 166/339] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:52:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:52:06.727332 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94db33-026c-4ab5-8774-1d8b76a78b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:06.727978 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94db33-026c-4ab5-8774-1d8b76a78b44 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:06.728256 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94db33-026c-4ab5-8774-1d8b76a78b44 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:06.728525 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94db33-026c-4ab5-8774-1d8b76a78b44 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:06.729833 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b94db33-026c-4ab5-8774-1d8b76a78b44 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:06.730136 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b94db33-026c-4ab5-8774-1d8b76a78b44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:06.731487 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b94db33-026c-4ab5-8774-1d8b76a78b44 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:06.740659 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 174/340] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 27 18:52:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:06.740965 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:06.747453 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d287b-4af8-4ea8-9f42-c4eafa5241cf None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:06.791161 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94db33-026c-4ab5-8774-1d8b76a78b44 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:06.820214 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:06.861785 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d287b-4af8-4ea8-9f42-c4eafa5241cf None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:06.908529 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6490ac-b6e2-466d-a11d-522974fa8569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:06.909176 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6490ac-b6e2-466d-a11d-522974fa8569 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:06.909456 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6490ac-b6e2-466d-a11d-522974fa8569 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:06.909730 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6490ac-b6e2-466d-a11d-522974fa8569 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:06.945990 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94db33-026c-4ab5-8774-1d8b76a78b44 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:06.986365 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6490ac-b6e2-466d-a11d-522974fa8569 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:06.987854 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6490ac-b6e2-466d-a11d-522974fa8569 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:07.001358 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ecb8c-e32d-455e-a085-2167bbe11511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:07.002013 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ecb8c-e32d-455e-a085-2167bbe11511 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:07.002291 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ecb8c-e32d-455e-a085-2167bbe11511 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:07.002559 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ecb8c-e32d-455e-a085-2167bbe11511 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:07.024809 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81ecb8c-e32d-455e-a085-2167bbe11511 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:52:07.031583 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-e81ecb8c-e32d-455e-a085-2167bbe11511 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:52:07.031583 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:07.031583 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:07.031583 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:07.031583 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:07.031583 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:07.031583 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:07.031583 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:07.031583 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:07.031583 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:07.031583 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:07.031583 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:07.031583 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:52:07.031583 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:52:07.031583 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:52:07.031583 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:52:07.032513 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:52:07.032513 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:52:07.032513 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:52:07.032513 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:52:07.032513 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:07.032513 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:07.032513 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:07.032513 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:07.032513 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:07.032513 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:07.032513 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:07.032513 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:07.032513 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:07.032513 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:07.032513 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:07.032513 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:07.033299 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:07.033299 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:07.033299 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:07.033299 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:07.033299 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:52:07.033299 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:52:07.033299 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:52:07.033299 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:52:07.033299 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:52:07.033299 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:52:07.033299 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:52:07.033299 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:07.037201 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 175/341] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 27 18:52:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:52:07.038419 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c19edb4-cb1f-4b4e-9824-19b625a7b3d4 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:07.038704 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c19edb4-cb1f-4b4e-9824-19b625a7b3d4 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:07.038977 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c19edb4-cb1f-4b4e-9824-19b625a7b3d4 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:07.042110 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 176/342] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:52:07.046217 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c575b55-ce3b-4658-b538-349f92828c67 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:07.046499 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c575b55-ce3b-4658-b538-349f92828c67 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:07.046769 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c575b55-ce3b-4658-b538-349f92828c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:07.057711 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:07.077401 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-4c575b55-ce3b-4658-b538-349f92828c67 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:07.078602 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-4c575b55-ce3b-4658-b538-349f92828c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:07.121287 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 167/343] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 27 18:52:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:52:07.122275 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6490ac-b6e2-466d-a11d-522974fa8569 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:07.175389 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:07.195078 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 177/344] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:52:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:52:07.196711 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c575b55-ce3b-4658-b538-349f92828c67 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:07.303499 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6490ac-b6e2-466d-a11d-522974fa8569 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:07.328118 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c575b55-ce3b-4658-b538-349f92828c67 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:07.371447 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a88cd-4cd2-4ef0-aafd-badf5cfab2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:07.372094 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a88cd-4cd2-4ef0-aafd-badf5cfab2b3 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:07.372368 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a88cd-4cd2-4ef0-aafd-badf5cfab2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:07.372639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a88cd-4cd2-4ef0-aafd-badf5cfab2b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:07.373365 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736a88cd-4cd2-4ef0-aafd-badf5cfab2b3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:07.373665 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736a88cd-4cd2-4ef0-aafd-badf5cfab2b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:07.375045 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736a88cd-4cd2-4ef0-aafd-badf5cfab2b3 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:07.379574 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bcea17-d1fb-4d1a-838f-8c630c116729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:07.380249 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bcea17-d1fb-4d1a-838f-8c630c116729 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:07.380524 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bcea17-d1fb-4d1a-838f-8c630c116729 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:07.380791 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bcea17-d1fb-4d1a-838f-8c630c116729 None admin] PATH_INFO: `/v3/projects/d85bb1f7e9394d898e25c565c5043262` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:07.382150 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bcea17-d1fb-4d1a-838f-8c630c116729 None admin] RBAC: Authorizing `identity:get_project(project_id=d85bb1f7e9394d898e25c565c5043262)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:07.383579 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bcea17-d1fb-4d1a-838f-8c630c116729 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:07.385964 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 178/345] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 27 18:52:07 2022] GET /identity/v3/projects/d85bb1f7e9394d898e25c565c5043262 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:07.389940 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bcea17-d1fb-4d1a-838f-8c630c116729 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:07.395943 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 168/346] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 27 18:52:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:07.396870 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a88cd-4cd2-4ef0-aafd-badf5cfab2b3 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:07.438518 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:07.533506 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:07.542204 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a88cd-4cd2-4ef0-aafd-badf5cfab2b3 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:07.590697 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e285e07-b56e-4dff-96d7-1478de0ffd09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:07.591325 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e285e07-b56e-4dff-96d7-1478de0ffd09 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:07.591602 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e285e07-b56e-4dff-96d7-1478de0ffd09 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:07.591898 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e285e07-b56e-4dff-96d7-1478de0ffd09 None admin] PATH_INFO: `/v3/groups/f93c1840227244b0b05a52e3d92fa4ea` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:07.598938 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e285e07-b56e-4dff-96d7-1478de0ffd09 None admin] RBAC: Authorizing `identity:get_group(group_id=f93c1840227244b0b05a52e3d92fa4ea)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:07.600555 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e285e07-b56e-4dff-96d7-1478de0ffd09 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:07.602700 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 169/347] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Jul 27 18:52:07 2022] GET /identity/v3/groups/f93c1840227244b0b05a52e3d92fa4ea => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:07.603608 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e285e07-b56e-4dff-96d7-1478de0ffd09 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:07.621889 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bcea17-d1fb-4d1a-838f-8c630c116729 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:07.704432 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f316b-97c3-4606-8a95-b1e3e4b5d5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:07.705098 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f316b-97c3-4606-8a95-b1e3e4b5d5f5 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:07.705383 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f316b-97c3-4606-8a95-b1e3e4b5d5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:07.705658 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f316b-97c3-4606-8a95-b1e3e4b5d5f5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:07.706527 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:07.721094 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1f316b-97c3-4606-8a95-b1e3e4b5d5f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:52:07.724466 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e285e07-b56e-4dff-96d7-1478de0ffd09 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:07.730529 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-8c1f316b-97c3-4606-8a95-b1e3e4b5d5f5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:52:07.730529 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:07.730529 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:07.730529 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:07.730529 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:07.730529 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:07.730529 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:07.730529 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:07.730529 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:07.730529 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:07.730529 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:07.730529 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:07.730529 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:52:07.730529 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:52:07.730529 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:52:07.730529 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:52:07.731520 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:52:07.731520 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:52:07.731520 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:52:07.731520 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:52:07.731520 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:07.731520 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:07.731520 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:07.731520 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:07.731520 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:07.731520 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:07.731520 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:07.731520 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:07.731520 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:07.731520 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:07.731520 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:07.731520 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:07.732352 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:07.732352 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:07.732352 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:07.732352 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:07.732352 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:52:07.732352 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:52:07.732352 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:52:07.732352 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:52:07.732352 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:52:07.732352 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:52:07.732352 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:52:07.732352 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:07.732352 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 179/348] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 27 18:52:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:07.732996 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f316b-97c3-4606-8a95-b1e3e4b5d5f5 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:07.780439 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d69009-a6fe-4937-81c9-79c53ff51656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:07.781080 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d69009-a6fe-4937-81c9-79c53ff51656 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:07.781365 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d69009-a6fe-4937-81c9-79c53ff51656 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:07.781641 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d69009-a6fe-4937-81c9-79c53ff51656 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:07.853929 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f316b-97c3-4606-8a95-b1e3e4b5d5f5 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:07.859210 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d69009-a6fe-4937-81c9-79c53ff51656 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:07.861242 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d69009-a6fe-4937-81c9-79c53ff51656 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:07.875449 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:07.897233 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6579a-45a1-414a-aa14-c9fecd5f0b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:07.897747 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6579a-45a1-414a-aa14-c9fecd5f0b32 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:07.898037 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6579a-45a1-414a-aa14-c9fecd5f0b32 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:07.898314 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6579a-45a1-414a-aa14-c9fecd5f0b32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:07.899108 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a6579a-45a1-414a-aa14-c9fecd5f0b32 None admin] RBAC: Adding query filter params (group.id=f93c1840227244b0b05a52e3d92fa4ea, role.id=8d808722e03a4591a59440f170ec672f, scope.project.id=d85bb1f7e9394d898e25c565c5043262) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:07.899419 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a6579a-45a1-414a-aa14-c9fecd5f0b32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:07.900966 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a6579a-45a1-414a-aa14-c9fecd5f0b32 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:07.907026 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 180/349] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Jul 27 18:52:07 2022] GET /identity/v3/role_assignments?group.id=f93c1840227244b0b05a52e3d92fa4ea&scope.project.id=d85bb1f7e9394d898e25c565c5043262&role.id=8d808722e03a4591a59440f170ec672f => generated 260 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:07.907880 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6579a-45a1-414a-aa14-c9fecd5f0b32 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:07.996285 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:08.015614 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 170/350] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 27 18:52:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:52:08.016949 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97e751-043b-467a-9daa-a67a476a9439 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:08.017233 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97e751-043b-467a-9daa-a67a476a9439 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:08.017506 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97e751-043b-467a-9daa-a67a476a9439 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:08.018904 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 171/351] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:52:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:52:08.024713 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97e751-043b-467a-9daa-a67a476a9439 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:08.106224 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6579a-45a1-414a-aa14-c9fecd5f0b32 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:08.159384 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58388d5d-7e47-45d7-acdb-058d97674d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:08.160040 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58388d5d-7e47-45d7-acdb-058d97674d50 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:08.160335 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58388d5d-7e47-45d7-acdb-058d97674d50 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:08.160592 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58388d5d-7e47-45d7-acdb-058d97674d50 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:08.161312 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58388d5d-7e47-45d7-acdb-058d97674d50 None admin] RBAC: Adding query filter params (name=member) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:08.161616 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58388d5d-7e47-45d7-acdb-058d97674d50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:08.162986 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58388d5d-7e47-45d7-acdb-058d97674d50 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:08.174559 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 181/352] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 27 18:52:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:08.175639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa8299-77e4-46e2-afe8-1f33e9e81781 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:08.176200 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa8299-77e4-46e2-afe8-1f33e9e81781 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:08.176200 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa8299-77e4-46e2-afe8-1f33e9e81781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:08.198311 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-3faa8299-77e4-46e2-afe8-1f33e9e81781 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:08.200577 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-3faa8299-77e4-46e2-afe8-1f33e9e81781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:08.203143 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97e751-043b-467a-9daa-a67a476a9439 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:08.255021 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:08.265572 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e65adf8-57d6-4e86-a006-42f109c536ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:08.267611 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65adf8-57d6-4e86-a006-42f109c536ee None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:08.268194 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65adf8-57d6-4e86-a006-42f109c536ee None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:08.268694 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65adf8-57d6-4e86-a006-42f109c536ee None admin] PATH_INFO: `/v3/projects/d85bb1f7e9394d898e25c565c5043262` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:08.270788 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e65adf8-57d6-4e86-a006-42f109c536ee None admin] RBAC: Authorizing `identity:get_project(project_id=d85bb1f7e9394d898e25c565c5043262)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:08.272577 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e65adf8-57d6-4e86-a006-42f109c536ee None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:08.275448 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 172/353] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 27 18:52:08 2022] GET /identity/v3/projects/d85bb1f7e9394d898e25c565c5043262 => generated 298 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:08.277045 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3125793-ef22-4179-b098-b0e2326a3667 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:08.277330 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3125793-ef22-4179-b098-b0e2326a3667 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:08.277605 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3125793-ef22-4179-b098-b0e2326a3667 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:08.279040 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 173/354] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:52:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:52:08.279589 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3125793-ef22-4179-b098-b0e2326a3667 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:08.304594 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 182/355] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:52:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:52:08.305905 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14e93e-7234-4115-b3ee-a456477d9f4c None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:08.306249 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14e93e-7234-4115-b3ee-a456477d9f4c None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:08.306527 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14e93e-7234-4115-b3ee-a456477d9f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:08.328548 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-dc14e93e-7234-4115-b3ee-a456477d9f4c None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:08.329743 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-dc14e93e-7234-4115-b3ee-a456477d9f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:08.355286 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:08.414363 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3125793-ef22-4179-b098-b0e2326a3667 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:08.423934 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 183/356] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:52:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:52:08.424849 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc14e93e-7234-4115-b3ee-a456477d9f4c None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:08.456342 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cc0da0-cca0-4c3d-ad18-86c4f48ba366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:08.456981 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc0da0-cca0-4c3d-ad18-86c4f48ba366 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:08.457265 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc0da0-cca0-4c3d-ad18-86c4f48ba366 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:08.457541 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc0da0-cca0-4c3d-ad18-86c4f48ba366 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:08.549132 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cc0da0-cca0-4c3d-ad18-86c4f48ba366 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:08.549869 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cc0da0-cca0-4c3d-ad18-86c4f48ba366 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:08.580537 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc14e93e-7234-4115-b3ee-a456477d9f4c None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:08.582679 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:08.625008 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:08.626169 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af8c03-a7a1-45d3-b735-fd416db24280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:08.626904 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af8c03-a7a1-45d3-b735-fd416db24280 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:08.627183 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af8c03-a7a1-45d3-b735-fd416db24280 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:08.627457 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af8c03-a7a1-45d3-b735-fd416db24280 None admin] PATH_INFO: `/v3/groups/f93c1840227244b0b05a52e3d92fa4ea` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:08.628688 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06af8c03-a7a1-45d3-b735-fd416db24280 None admin] RBAC: Authorizing `identity:get_group(group_id=f93c1840227244b0b05a52e3d92fa4ea)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:08.630122 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06af8c03-a7a1-45d3-b735-fd416db24280 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:08.631764 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 184/357] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Jul 27 18:52:08 2022] GET /identity/v3/groups/f93c1840227244b0b05a52e3d92fa4ea => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:08.632521 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af8c03-a7a1-45d3-b735-fd416db24280 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:08.681033 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 174/358] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 27 18:52:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:52:08.683367 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cc0da0-cca0-4c3d-ad18-86c4f48ba366 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:08.755251 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af8c03-a7a1-45d3-b735-fd416db24280 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:08.797009 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb4600-2739-468c-ac8e-3686a883976f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:08.797523 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cc0da0-cca0-4c3d-ad18-86c4f48ba366 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:08.798184 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb4600-2739-468c-ac8e-3686a883976f None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:08.798645 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb4600-2739-468c-ac8e-3686a883976f None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:08.799093 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb4600-2739-468c-ac8e-3686a883976f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:08.814367 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bb4600-2739-468c-ac8e-3686a883976f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:52:08.819458 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-02bb4600-2739-468c-ac8e-3686a883976f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:52:08.819458 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:08.819458 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:08.819458 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:08.819458 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:08.819458 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:08.819458 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:08.819458 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:08.819458 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:08.819458 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:08.819458 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:08.819458 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:08.819458 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:52:08.819458 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:52:08.819458 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:52:08.819458 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:52:08.820442 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:52:08.820442 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:52:08.820442 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:52:08.820442 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:52:08.820442 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:08.820442 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:08.820442 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:08.820442 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:08.820442 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:08.820442 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:08.820442 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:08.820442 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:08.820442 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:08.820442 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:08.820442 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:08.820442 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:08.821562 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:08.821562 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:08.821562 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:08.821562 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:08.821562 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:52:08.821562 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:52:08.821562 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:52:08.821562 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:52:08.821562 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:52:08.821562 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:52:08.821562 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:52:08.821562 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:08.821562 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 185/359] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 27 18:52:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:08.823000 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb4600-2739-468c-ac8e-3686a883976f None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:08.845431 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c49f15f-6b1c-4011-84bd-a5de7c9469fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:08.846338 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49f15f-6b1c-4011-84bd-a5de7c9469fb None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:08.846764 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49f15f-6b1c-4011-84bd-a5de7c9469fb None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:08.847635 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49f15f-6b1c-4011-84bd-a5de7c9469fb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:08.863964 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:08.864332 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c49f15f-6b1c-4011-84bd-a5de7c9469fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:52:08.870584 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-6c49f15f-6b1c-4011-84bd-a5de7c9469fb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 18:52:08.870584 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:08.870584 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:08.870584 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:08.870584 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:08.870584 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:08.870584 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:08.870584 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:08.870584 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:08.870584 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:08.870584 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:08.870584 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:08.870584 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:52:08.870584 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:52:08.870584 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:52:08.870584 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:52:08.871478 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:52:08.871478 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:52:08.871478 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:52:08.871478 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:52:08.871478 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:08.871478 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:08.871478 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:08.871478 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:08.871478 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:08.871478 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:08.871478 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:08.871478 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:08.871478 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:08.871478 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:08.871478 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:08.871478 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:08.872766 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:08.872766 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:08.872766 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:08.872766 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:08.872766 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:52:08.872766 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:52:08.872766 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:52:08.872766 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:52:08.872766 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:52:08.872766 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:52:08.872766 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 18:52:08.872766 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:08.872766 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 175/360] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 27 18:52:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:08.872766 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4523be-3317-4ebc-ad0f-360c8ad6349d None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:08.873678 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4523be-3317-4ebc-ad0f-360c8ad6349d None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:08.873763 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4523be-3317-4ebc-ad0f-360c8ad6349d None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:08.874988 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 176/361] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:52:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:52:08.875670 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4523be-3317-4ebc-ad0f-360c8ad6349d None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:08.896765 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:08.967104 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb4600-2739-468c-ac8e-3686a883976f None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:09.004565 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4523be-3317-4ebc-ad0f-360c8ad6349d None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:09.017587 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e512e22-8c39-4e4e-8ce3-b6402d594a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:09.018539 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e512e22-8c39-4e4e-8ce3-b6402d594a72 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:09.018888 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e512e22-8c39-4e4e-8ce3-b6402d594a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:09.019234 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e512e22-8c39-4e4e-8ce3-b6402d594a72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:09.020559 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e512e22-8c39-4e4e-8ce3-b6402d594a72 None admin] RBAC: Adding query filter params (group.id=f93c1840227244b0b05a52e3d92fa4ea, role.id=448ae448fe9a474ab1166ca18f7ac4d8, scope.project.id=d85bb1f7e9394d898e25c565c5043262) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:09.020559 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e512e22-8c39-4e4e-8ce3-b6402d594a72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:09.021939 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e512e22-8c39-4e4e-8ce3-b6402d594a72 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:09.032161 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 186/362] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Jul 27 18:52:08 2022] GET /identity/v3/role_assignments?group.id=f93c1840227244b0b05a52e3d92fa4ea&scope.project.id=d85bb1f7e9394d898e25c565c5043262&role.id=448ae448fe9a474ab1166ca18f7ac4d8 => generated 260 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:09.032868 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e512e22-8c39-4e4e-8ce3-b6402d594a72 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:09.053487 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac61cbd2-a9fb-407f-a285-731061ef3984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:09.054154 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61cbd2-a9fb-407f-a285-731061ef3984 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:09.054440 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61cbd2-a9fb-407f-a285-731061ef3984 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:09.054717 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61cbd2-a9fb-407f-a285-731061ef3984 None admin] PATH_INFO: `/v3/projects/fb4af7b5833b4b5b84a3c061a2fc98c8` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:09.057827 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac61cbd2-a9fb-407f-a285-731061ef3984 None admin] RBAC: Authorizing `identity:get_project(project_id=fb4af7b5833b4b5b84a3c061a2fc98c8)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:09.060073 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac61cbd2-a9fb-407f-a285-731061ef3984 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:09.062954 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 177/363] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 27 18:52:08 2022] GET /identity/v3/projects/fb4af7b5833b4b5b84a3c061a2fc98c8 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:09.064328 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac61cbd2-a9fb-407f-a285-731061ef3984 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:09.171594 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:09.180426 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e512e22-8c39-4e4e-8ce3-b6402d594a72 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:09.196612 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:09.225265 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac61cbd2-a9fb-407f-a285-731061ef3984 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:09.227436 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d9d59-b382-45a1-a2b8-11a3b48598b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:09.228206 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d9d59-b382-45a1-a2b8-11a3b48598b2 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:09.228564 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d9d59-b382-45a1-a2b8-11a3b48598b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:09.229509 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d9d59-b382-45a1-a2b8-11a3b48598b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:09.230737 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d9d59-b382-45a1-a2b8-11a3b48598b2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:09.230737 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d9d59-b382-45a1-a2b8-11a3b48598b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:09.234001 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d9d59-b382-45a1-a2b8-11a3b48598b2 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:09.246216 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 187/364] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 27 18:52:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:09.247471 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ce00e-4c9c-4644-9a04-f152114d6957 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:09.247793 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ce00e-4c9c-4644-9a04-f152114d6957 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:09.248074 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ce00e-4c9c-4644-9a04-f152114d6957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:09.272807 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-f23ce00e-4c9c-4644-9a04-f152114d6957 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:09.274271 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e9afd-e64b-4e69-abdc-d3f40618796b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:09.274621 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-f23ce00e-4c9c-4644-9a04-f152114d6957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:09.274910 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e9afd-e64b-4e69-abdc-d3f40618796b None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:09.275193 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e9afd-e64b-4e69-abdc-d3f40618796b None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:09.275471 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e9afd-e64b-4e69-abdc-d3f40618796b None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:09.276775 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e9afd-e64b-4e69-abdc-d3f40618796b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:09.277080 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e9afd-e64b-4e69-abdc-d3f40618796b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:09.278739 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e9afd-e64b-4e69-abdc-d3f40618796b None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:09.295785 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 178/365] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 27 18:52:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:09.299812 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e9afd-e64b-4e69-abdc-d3f40618796b None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:09.374897 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 188/366] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:52:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:52:09.376209 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ce00e-4c9c-4644-9a04-f152114d6957 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:09.442846 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e9afd-e64b-4e69-abdc-d3f40618796b None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:09.483719 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f00f4-bf3c-4912-8841-aa981e89184d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:09.484574 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:09.485500 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f00f4-bf3c-4912-8841-aa981e89184d None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:09.486204 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f00f4-bf3c-4912-8841-aa981e89184d None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:09.486633 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f00f4-bf3c-4912-8841-aa981e89184d None admin] PATH_INFO: `/v3/groups/f93c1840227244b0b05a52e3d92fa4ea` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:09.487972 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f00f4-bf3c-4912-8841-aa981e89184d None admin] RBAC: Authorizing `identity:get_group(group_id=f93c1840227244b0b05a52e3d92fa4ea)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:09.489914 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f00f4-bf3c-4912-8841-aa981e89184d None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:09.491725 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 179/367] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Jul 27 18:52:09 2022] GET /identity/v3/groups/f93c1840227244b0b05a52e3d92fa4ea => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:09.498915 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f00f4-bf3c-4912-8841-aa981e89184d None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:09.502283 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ce00e-4c9c-4644-9a04-f152114d6957 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:09.523421 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:09.553457 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded7993a-6f8b-4ece-b63a-20412feb6440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:09.554411 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7993a-6f8b-4ece-b63a-20412feb6440 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:09.554912 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7993a-6f8b-4ece-b63a-20412feb6440 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:09.555391 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7993a-6f8b-4ece-b63a-20412feb6440 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:09.626583 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f00f4-bf3c-4912-8841-aa981e89184d None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:09.628183 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded7993a-6f8b-4ece-b63a-20412feb6440 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:09.629856 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded7993a-6f8b-4ece-b63a-20412feb6440 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:09.667334 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede777df-8dbd-475b-99f4-102ae7702873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:09.668091 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede777df-8dbd-475b-99f4-102ae7702873 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:09.668378 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede777df-8dbd-475b-99f4-102ae7702873 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:09.668656 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede777df-8dbd-475b-99f4-102ae7702873 None admin] PATH_INFO: `/v3/users/6867f61485ae4f88a6e1d16833be6c80` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:09.669894 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede777df-8dbd-475b-99f4-102ae7702873 None admin] RBAC: Authorizing `identity:get_user(user_id=6867f61485ae4f88a6e1d16833be6c80)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:09.671518 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede777df-8dbd-475b-99f4-102ae7702873 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:09.673558 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 180/368] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 27 18:52:09 2022] GET /identity/v3/users/6867f61485ae4f88a6e1d16833be6c80 => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:09.674329 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede777df-8dbd-475b-99f4-102ae7702873 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:09.729928 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:09.747097 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 189/369] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 27 18:52:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:52:09.748306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded7993a-6f8b-4ece-b63a-20412feb6440 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:09.772465 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:09.792796 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede777df-8dbd-475b-99f4-102ae7702873 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:09.830757 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47273552-8e3e-45a9-bf32-d8c542d07178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:09.831409 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47273552-8e3e-45a9-bf32-d8c542d07178 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:09.831710 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47273552-8e3e-45a9-bf32-d8c542d07178 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:09.831996 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47273552-8e3e-45a9-bf32-d8c542d07178 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:09.843219 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47273552-8e3e-45a9-bf32-d8c542d07178 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:52:09.849559 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-47273552-8e3e-45a9-bf32-d8c542d07178 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:52:09.849559 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:09.849559 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:09.849559 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:09.849559 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:09.849559 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:09.849559 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:09.849559 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:09.849559 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:09.849559 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:09.849559 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:09.849559 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:09.849559 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:52:09.849559 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:52:09.849559 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:52:09.849559 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:52:09.850464 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:52:09.850464 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:52:09.850464 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:52:09.850464 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:52:09.850464 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:09.850464 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:09.850464 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:09.850464 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:09.850464 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:09.850464 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:09.850464 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:09.850464 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:09.850464 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:09.850464 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:09.850464 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:09.850464 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:09.851234 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:09.851234 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:09.851234 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:09.851234 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:09.851234 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:52:09.851234 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:52:09.851234 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:52:09.851234 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:52:09.851234 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:52:09.851234 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:52:09.851234 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:52:09.851234 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:09.856258 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 181/370] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 27 18:52:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:09.857122 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded7993a-6f8b-4ece-b63a-20412feb6440 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:09.857249 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47273552-8e3e-45a9-bf32-d8c542d07178 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:09.895800 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4ac90-fedb-440d-a070-57b4980f613c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:09.896794 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4ac90-fedb-440d-a070-57b4980f613c None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:09.897293 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4ac90-fedb-440d-a070-57b4980f613c None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:09.897760 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4ac90-fedb-440d-a070-57b4980f613c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:09.898759 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed4ac90-fedb-440d-a070-57b4980f613c None admin] RBAC: Adding query filter params (group.id=f93c1840227244b0b05a52e3d92fa4ea, role.id=448ae448fe9a474ab1166ca18f7ac4d8, scope.project.id=fb4af7b5833b4b5b84a3c061a2fc98c8) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:09.899267 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed4ac90-fedb-440d-a070-57b4980f613c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:09.900972 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed4ac90-fedb-440d-a070-57b4980f613c None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:09.907017 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 190/371] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Jul 27 18:52:09 2022] GET /identity/v3/role_assignments?group.id=f93c1840227244b0b05a52e3d92fa4ea&scope.project.id=fb4af7b5833b4b5b84a3c061a2fc98c8&role.id=448ae448fe9a474ab1166ca18f7ac4d8 => generated 260 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:09.909217 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4ac90-fedb-440d-a070-57b4980f613c None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:09.980255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:10.049428 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47273552-8e3e-45a9-bf32-d8c542d07178 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:10.096371 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650036e3-f4ad-4e08-97cb-53458889f56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:10.097389 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650036e3-f4ad-4e08-97cb-53458889f56a None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:10.097866 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650036e3-f4ad-4e08-97cb-53458889f56a None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:10.098349 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650036e3-f4ad-4e08-97cb-53458889f56a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:10.099351 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650036e3-f4ad-4e08-97cb-53458889f56a None admin] RBAC: Adding query filter params (role.id=7cf1c5f66b514f79bd5f95c17ac73d46, user.id=6867f61485ae4f88a6e1d16833be6c80, scope.system=all) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:10.100098 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650036e3-f4ad-4e08-97cb-53458889f56a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:10.101782 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650036e3-f4ad-4e08-97cb-53458889f56a None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:10.101984 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4ac90-fedb-440d-a070-57b4980f613c None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:10.117563 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 182/372] 10.222.0.20 () {56 vars in 1308 bytes} [Wed Jul 27 18:52:09 2022] GET /identity/v3/role_assignments?user.id=6867f61485ae4f88a6e1d16833be6c80&scope.system=all&role.id=7cf1c5f66b514f79bd5f95c17ac73d46 => generated 510 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:10.118761 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650036e3-f4ad-4e08-97cb-53458889f56a None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:10.122062 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:10.168218 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb4f04-7154-40bc-bef8-e04150ca7e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:10.169246 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb4f04-7154-40bc-bef8-e04150ca7e04 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:10.169758 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb4f04-7154-40bc-bef8-e04150ca7e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:10.170248 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb4f04-7154-40bc-bef8-e04150ca7e04 None admin] PATH_INFO: `/v3/projects/fb4af7b5833b4b5b84a3c061a2fc98c8` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:10.171902 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bb4f04-7154-40bc-bef8-e04150ca7e04 None admin] RBAC: Authorizing `identity:get_project(project_id=fb4af7b5833b4b5b84a3c061a2fc98c8)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:10.173610 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bb4f04-7154-40bc-bef8-e04150ca7e04 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:10.175886 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 191/373] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 27 18:52:09 2022] GET /identity/v3/projects/fb4af7b5833b4b5b84a3c061a2fc98c8 => generated 302 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:10.181517 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb4f04-7154-40bc-bef8-e04150ca7e04 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:10.255586 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650036e3-f4ad-4e08-97cb-53458889f56a None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:10.299333 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86e4ac-ef75-4805-8732-dc248d5e8e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:10.300093 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86e4ac-ef75-4805-8732-dc248d5e8e07 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:10.300315 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86e4ac-ef75-4805-8732-dc248d5e8e07 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:10.300588 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86e4ac-ef75-4805-8732-dc248d5e8e07 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:10.301337 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d86e4ac-ef75-4805-8732-dc248d5e8e07 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:10.301645 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d86e4ac-ef75-4805-8732-dc248d5e8e07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:10.303781 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d86e4ac-ef75-4805-8732-dc248d5e8e07 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:10.316853 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 183/374] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 27 18:52:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:10.319791 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb4f04-7154-40bc-bef8-e04150ca7e04 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:10.324516 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86e4ac-ef75-4805-8732-dc248d5e8e07 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:10.342594 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:10.372542 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48764f-dd8d-438c-80f5-99ec78450f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:10.373205 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48764f-dd8d-438c-80f5-99ec78450f59 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:10.373485 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48764f-dd8d-438c-80f5-99ec78450f59 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:10.373758 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48764f-dd8d-438c-80f5-99ec78450f59 None admin] PATH_INFO: `/v3/groups/f93c1840227244b0b05a52e3d92fa4ea` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:10.375742 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd48764f-dd8d-438c-80f5-99ec78450f59 None admin] RBAC: Authorizing `identity:get_group(group_id=f93c1840227244b0b05a52e3d92fa4ea)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:10.377144 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd48764f-dd8d-438c-80f5-99ec78450f59 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:10.378912 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 192/375] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Jul 27 18:52:10 2022] GET /identity/v3/groups/f93c1840227244b0b05a52e3d92fa4ea => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:10.388844 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48764f-dd8d-438c-80f5-99ec78450f59 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:10.454723 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:10.528572 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86e4ac-ef75-4805-8732-dc248d5e8e07 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:10.555418 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48764f-dd8d-438c-80f5-99ec78450f59 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:10.571588 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edf0c97-5751-49e9-9649-ac2f6c45cff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:10.572252 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf0c97-5751-49e9-9649-ac2f6c45cff9 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:10.572577 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf0c97-5751-49e9-9649-ac2f6c45cff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:10.572859 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf0c97-5751-49e9-9649-ac2f6c45cff9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:10.598540 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b73724-2eec-41b0-a555-0ea25d834bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:10.599510 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b73724-2eec-41b0-a555-0ea25d834bb9 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:10.600144 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b73724-2eec-41b0-a555-0ea25d834bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:10.600480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b73724-2eec-41b0-a555-0ea25d834bb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:10.601335 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b73724-2eec-41b0-a555-0ea25d834bb9 None admin] RBAC: Adding query filter params (group.id=f93c1840227244b0b05a52e3d92fa4ea, role.id=8d808722e03a4591a59440f170ec672f, scope.project.id=fb4af7b5833b4b5b84a3c061a2fc98c8) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:10.601723 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b73724-2eec-41b0-a555-0ea25d834bb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:10.603366 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b73724-2eec-41b0-a555-0ea25d834bb9 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:10.611415 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 193/376] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Jul 27 18:52:10 2022] GET /identity/v3/role_assignments?group.id=f93c1840227244b0b05a52e3d92fa4ea&scope.project.id=fb4af7b5833b4b5b84a3c061a2fc98c8&role.id=8d808722e03a4591a59440f170ec672f => generated 260 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:10.618154 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85ecd2-ab82-422e-98a7-57036a4524d1 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:10.618154 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85ecd2-ab82-422e-98a7-57036a4524d1 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:10.618154 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85ecd2-ab82-422e-98a7-57036a4524d1 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:10.618154 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 194/377] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:52:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:52:10.624474 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3cfa2-ac49-4a0f-b391-7be69b51a425 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:10.627145 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3cfa2-ac49-4a0f-b391-7be69b51a425 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:10.627660 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3cfa2-ac49-4a0f-b391-7be69b51a425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:10.660160 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-06d3cfa2-ac49-4a0f-b391-7be69b51a425 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:10.663600 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-06d3cfa2-ac49-4a0f-b391-7be69b51a425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:10.692888 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edf0c97-5751-49e9-9649-ac2f6c45cff9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:10.694370 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edf0c97-5751-49e9-9649-ac2f6c45cff9 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:10.734047 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:10.770149 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 195/378] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:52:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:52:10.807703 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3cfa2-ac49-4a0f-b391-7be69b51a425 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:10.820676 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:10.880859 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 184/379] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 27 18:52:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 18:52:10.886989 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edf0c97-5751-49e9-9649-ac2f6c45cff9 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:11.004368 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3cfa2-ac49-4a0f-b391-7be69b51a425 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:11.074519 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daba71f-d482-48f1-ba5b-df8a9c57cc17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:11.075091 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daba71f-d482-48f1-ba5b-df8a9c57cc17 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:11.075371 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daba71f-d482-48f1-ba5b-df8a9c57cc17 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:11.075643 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daba71f-d482-48f1-ba5b-df8a9c57cc17 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:11.082408 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edf0c97-5751-49e9-9649-ac2f6c45cff9 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:11.103139 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daba71f-d482-48f1-ba5b-df8a9c57cc17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:52:11.113020 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-4daba71f-d482-48f1-ba5b-df8a9c57cc17 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:52:11.113020 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:11.113020 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:11.113020 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:11.113020 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:11.113020 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:11.113020 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:11.113020 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:11.113020 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:11.113020 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:11.113020 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:11.113020 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:11.113020 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:52:11.113020 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:52:11.113020 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:52:11.113020 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:52:11.114003 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:52:11.114003 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:52:11.114003 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:52:11.114003 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:52:11.114003 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:11.114003 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:11.114003 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:11.114003 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:11.114003 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:11.114003 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:11.114003 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:11.114003 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:11.114003 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:11.114003 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:11.114003 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:11.114003 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:11.114786 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:11.114786 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:11.114786 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:11.114786 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:11.114786 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:52:11.114786 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:52:11.114786 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:52:11.114786 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:52:11.114786 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:52:11.114786 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:52:11.114786 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:52:11.114786 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:11.118107 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 196/380] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 27 18:52:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:11.119953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daba71f-d482-48f1-ba5b-df8a9c57cc17 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:11.155759 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0570cddb-7038-4c43-a170-8cb380619b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:11.156402 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570cddb-7038-4c43-a170-8cb380619b6f None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:11.156679 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570cddb-7038-4c43-a170-8cb380619b6f None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:11.156948 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570cddb-7038-4c43-a170-8cb380619b6f None admin] PATH_INFO: `/v3/projects/6643b58dd5014772a6237180b96549c9` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:11.160976 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0570cddb-7038-4c43-a170-8cb380619b6f None admin] RBAC: Authorizing `identity:get_project(project_id=6643b58dd5014772a6237180b96549c9)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:11.162467 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0570cddb-7038-4c43-a170-8cb380619b6f None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:11.165453 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 185/381] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 27 18:52:10 2022] GET /identity/v3/projects/6643b58dd5014772a6237180b96549c9 => generated 344 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:11.172184 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0570cddb-7038-4c43-a170-8cb380619b6f None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:11.212079 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:11.235028 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:11.305520 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daba71f-d482-48f1-ba5b-df8a9c57cc17 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:11.377803 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6364559-615a-4769-bfae-d00d8219240b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:11.378507 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6364559-615a-4769-bfae-d00d8219240b None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:11.378797 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6364559-615a-4769-bfae-d00d8219240b None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:11.379069 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6364559-615a-4769-bfae-d00d8219240b None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:11.379831 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6364559-615a-4769-bfae-d00d8219240b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:11.380137 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6364559-615a-4769-bfae-d00d8219240b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:11.382170 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6364559-615a-4769-bfae-d00d8219240b None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:11.384204 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0570cddb-7038-4c43-a170-8cb380619b6f None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:11.399730 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 197/382] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 27 18:52:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:11.406731 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6364559-615a-4769-bfae-d00d8219240b None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:11.437858 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f96e76f-545e-4619-9424-f69a3e20f056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:11.438945 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96e76f-545e-4619-9424-f69a3e20f056 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:11.439565 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96e76f-545e-4619-9424-f69a3e20f056 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:11.440074 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96e76f-545e-4619-9424-f69a3e20f056 None admin] PATH_INFO: `/v3/groups/f5776c89b13047ba851e307d4eb06864` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:11.448693 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f96e76f-545e-4619-9424-f69a3e20f056 None admin] RBAC: Authorizing `identity:get_group(group_id=f5776c89b13047ba851e307d4eb06864)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:11.450541 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f96e76f-545e-4619-9424-f69a3e20f056 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:11.452872 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 186/383] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Jul 27 18:52:11 2022] GET /identity/v3/groups/f5776c89b13047ba851e307d4eb06864 => generated 229 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:52:11.460603 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f96e76f-545e-4619-9424-f69a3e20f056 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:11.618381 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6364559-615a-4769-bfae-d00d8219240b None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:11.619678 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:11.620735 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:11.627955 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f96e76f-545e-4619-9424-f69a3e20f056 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:11.684533 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc87742-b558-46f5-81b4-52851f21ea4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:11.685560 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc87742-b558-46f5-81b4-52851f21ea4c None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:11.686037 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc87742-b558-46f5-81b4-52851f21ea4c None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:11.686520 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc87742-b558-46f5-81b4-52851f21ea4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:11.688527 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc87742-b558-46f5-81b4-52851f21ea4c None admin] RBAC: Adding query filter params (group.id=f5776c89b13047ba851e307d4eb06864, role.id=0f4a39b061e148418413cfe647af9a34, scope.project.id=6643b58dd5014772a6237180b96549c9) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:11.689131 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc87742-b558-46f5-81b4-52851f21ea4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:11.690813 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc87742-b558-46f5-81b4-52851f21ea4c None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:11.698254 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 187/384] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Jul 27 18:52:11 2022] GET /identity/v3/role_assignments?group.id=f5776c89b13047ba851e307d4eb06864&scope.project.id=6643b58dd5014772a6237180b96549c9&role.id=0f4a39b061e148418413cfe647af9a34 => generated 260 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:11.699821 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03039e2-c263-44f6-9921-8f87c10f93e5 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:11.700345 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03039e2-c263-44f6-9921-8f87c10f93e5 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:11.700829 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03039e2-c263-44f6-9921-8f87c10f93e5 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:11.701014 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1604862-28ea-4620-a5c2-545dab5b8be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:11.701667 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1604862-28ea-4620-a5c2-545dab5b8be1 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:11.701950 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1604862-28ea-4620-a5c2-545dab5b8be1 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:11.702224 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1604862-28ea-4620-a5c2-545dab5b8be1 None admin] PATH_INFO: `/v3/groups/f93c1840227244b0b05a52e3d92fa4ea` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:11.703169 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 188/385] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:52:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:52:11.707364 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1604862-28ea-4620-a5c2-545dab5b8be1 None admin] RBAC: Authorizing `identity:get_group(group_id=f93c1840227244b0b05a52e3d92fa4ea)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:11.707364 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1604862-28ea-4620-a5c2-545dab5b8be1 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:11.707364 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 198/386] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Jul 27 18:52:11 2022] GET /identity/v3/groups/f93c1840227244b0b05a52e3d92fa4ea => generated 226 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:11.719744 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1604862-28ea-4620-a5c2-545dab5b8be1 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:11.719980 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd365d-e834-43ac-88d1-07d7d91aed8e None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:11.719980 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd365d-e834-43ac-88d1-07d7d91aed8e None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:11.719980 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd365d-e834-43ac-88d1-07d7d91aed8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:11.754479 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-56cd365d-e834-43ac-88d1-07d7d91aed8e None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:11.756131 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-56cd365d-e834-43ac-88d1-07d7d91aed8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:11.868507 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 189/387] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:52:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:52:11.904956 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd365d-e834-43ac-88d1-07d7d91aed8e None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:11.981299 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1604862-28ea-4620-a5c2-545dab5b8be1 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:12.052500 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d189b-8797-4284-b62d-4b70bf03d606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:12.053575 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d189b-8797-4284-b62d-4b70bf03d606 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:12.054105 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d189b-8797-4284-b62d-4b70bf03d606 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:12.054580 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d189b-8797-4284-b62d-4b70bf03d606 None admin] PATH_INFO: `/v3/projects/d85bb1f7e9394d898e25c565c5043262` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:12.057412 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9d189b-8797-4284-b62d-4b70bf03d606 None admin] RBAC: Authorizing `identity:get_project(project_id=d85bb1f7e9394d898e25c565c5043262)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:12.059053 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9d189b-8797-4284-b62d-4b70bf03d606 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:12.065593 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 199/388] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 27 18:52:11 2022] GET /identity/v3/projects/d85bb1f7e9394d898e25c565c5043262 => generated 298 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:12.070524 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d189b-8797-4284-b62d-4b70bf03d606 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:12.135957 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:12.146296 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:12.183506 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd365d-e834-43ac-88d1-07d7d91aed8e None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:12.219758 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d189b-8797-4284-b62d-4b70bf03d606 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:12.267305 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd86e3-9b95-4451-8df6-9b8949b4dbb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:12.268112 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd86e3-9b95-4451-8df6-9b8949b4dbb7 None admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:12.268390 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd86e3-9b95-4451-8df6-9b8949b4dbb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:12.268661 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd86e3-9b95-4451-8df6-9b8949b4dbb7 None admin] PATH_INFO: `/v3/projects/d85bb1f7e9394d898e25c565c5043262/groups/f93c1840227244b0b05a52e3d92fa4ea/roles/8d808722e03a4591a59440f170ec672f` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:12.271415 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dd86e3-9b95-4451-8df6-9b8949b4dbb7 None admin] RBAC: Authorizing `identity:create_grant(project_id=d85bb1f7e9394d898e25c565c5043262, group_id=f93c1840227244b0b05a52e3d92fa4ea, role_id=8d808722e03a4591a59440f170ec672f)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:12.272869 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dd86e3-9b95-4451-8df6-9b8949b4dbb7 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:12.286738 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacee512-8749-4164-a742-07e8e35b758b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:12.287719 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacee512-8749-4164-a742-07e8e35b758b None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:12.288208 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacee512-8749-4164-a742-07e8e35b758b None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:12.288667 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacee512-8749-4164-a742-07e8e35b758b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:12.299020 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 200/389] 10.222.0.20 () {58 vars in 1442 bytes} [Wed Jul 27 18:52:12 2022] PUT /identity/v3/projects/d85bb1f7e9394d898e25c565c5043262/groups/f93c1840227244b0b05a52e3d92fa4ea/roles/8d808722e03a4591a59440f170ec672f => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:12.318995 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacee512-8749-4164-a742-07e8e35b758b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:52:12.324934 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-bacee512-8749-4164-a742-07e8e35b758b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:52:12.324934 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:12.324934 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:12.324934 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:12.324934 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:12.324934 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:12.324934 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:12.324934 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:12.324934 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:12.324934 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:12.324934 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:12.324934 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:12.324934 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:52:12.324934 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:52:12.324934 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:52:12.324934 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:52:12.325901 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:52:12.325901 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:52:12.325901 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:52:12.325901 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:52:12.325901 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:12.325901 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:12.325901 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:12.325901 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:12.325901 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:12.325901 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:12.325901 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:12.325901 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:12.325901 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:12.325901 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:12.325901 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:12.325901 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:12.327159 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:12.327159 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:12.327159 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:12.327159 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:12.327159 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:52:12.327159 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:52:12.327159 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:52:12.327159 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:52:12.327159 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:52:12.327159 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:52:12.327159 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:52:12.327159 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:12.327159 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 190/390] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 27 18:52:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 424 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:12.334462 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd86e3-9b95-4451-8df6-9b8949b4dbb7 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:12.467223 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:12.472050 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd86e3-9b95-4451-8df6-9b8949b4dbb7 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:12.519144 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc43e73-ecf3-4a17-beca-d85de4da7046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:12.520201 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc43e73-ecf3-4a17-beca-d85de4da7046 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:12.520702 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc43e73-ecf3-4a17-beca-d85de4da7046 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:12.521167 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc43e73-ecf3-4a17-beca-d85de4da7046 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:12.522080 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc43e73-ecf3-4a17-beca-d85de4da7046 None admin] RBAC: Adding query filter params (name=member) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:12.522587 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc43e73-ecf3-4a17-beca-d85de4da7046 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:12.524181 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc43e73-ecf3-4a17-beca-d85de4da7046 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:12.538836 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 201/391] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 27 18:52:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:12.545341 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacee512-8749-4164-a742-07e8e35b758b None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:12.669780 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacee512-8749-4164-a742-07e8e35b758b None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:12.711472 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90fbc70-e629-47e8-8249-09b55802dad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:12.712138 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90fbc70-e629-47e8-8249-09b55802dad8 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:12.712415 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90fbc70-e629-47e8-8249-09b55802dad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:12.712684 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90fbc70-e629-47e8-8249-09b55802dad8 None admin] PATH_INFO: `/v3/groups/f93c1840227244b0b05a52e3d92fa4ea` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:12.713862 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90fbc70-e629-47e8-8249-09b55802dad8 None admin] RBAC: Authorizing `identity:get_group(group_id=f93c1840227244b0b05a52e3d92fa4ea)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:12.715287 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90fbc70-e629-47e8-8249-09b55802dad8 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:12.717111 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 191/392] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Jul 27 18:52:12 2022] GET /identity/v3/groups/f93c1840227244b0b05a52e3d92fa4ea => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:12.729375 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc43e73-ecf3-4a17-beca-d85de4da7046 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:12.786662 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eaf79b-f9c9-4f23-977b-9ebc11b343d0 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:12.787104 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eaf79b-f9c9-4f23-977b-9ebc11b343d0 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:12.787386 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eaf79b-f9c9-4f23-977b-9ebc11b343d0 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:12.789027 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 192/393] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:52:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:52:12.796125 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eccfa16-942f-4232-90a4-d3140a9227cf None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:12.796408 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eccfa16-942f-4232-90a4-d3140a9227cf None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:12.796681 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eccfa16-942f-4232-90a4-d3140a9227cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:12.818907 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-0eccfa16-942f-4232-90a4-d3140a9227cf None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:12.820597 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-0eccfa16-942f-4232-90a4-d3140a9227cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:12.844045 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:12.910040 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc43e73-ecf3-4a17-beca-d85de4da7046 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:12.930181 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 193/394] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:52:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:52:12.956700 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eccfa16-942f-4232-90a4-d3140a9227cf None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:13.002925 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa115a86-69af-492d-a903-8f27665f1f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:13.003987 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa115a86-69af-492d-a903-8f27665f1f23 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:13.004490 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa115a86-69af-492d-a903-8f27665f1f23 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:13.007506 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa115a86-69af-492d-a903-8f27665f1f23 None admin] PATH_INFO: `/v3/projects/d85bb1f7e9394d898e25c565c5043262` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:13.014745 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa115a86-69af-492d-a903-8f27665f1f23 None admin] RBAC: Authorizing `identity:get_project(project_id=d85bb1f7e9394d898e25c565c5043262)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:13.016774 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa115a86-69af-492d-a903-8f27665f1f23 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:13.023637 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 202/395] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 27 18:52:12 2022] GET /identity/v3/projects/d85bb1f7e9394d898e25c565c5043262 => generated 298 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:13.027231 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa115a86-69af-492d-a903-8f27665f1f23 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:13.079519 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eccfa16-942f-4232-90a4-d3140a9227cf None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:13.092051 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:13.122696 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae51c0fa-75d8-47de-be12-f4d6fd666ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:13.123344 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51c0fa-75d8-47de-be12-f4d6fd666ab2 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:13.123619 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51c0fa-75d8-47de-be12-f4d6fd666ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:13.123910 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae51c0fa-75d8-47de-be12-f4d6fd666ab2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:13.135641 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae51c0fa-75d8-47de-be12-f4d6fd666ab2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:52:13.141120 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-ae51c0fa-75d8-47de-be12-f4d6fd666ab2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:52:13.141120 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:13.141120 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:13.141120 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:13.141120 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:13.141120 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:13.141120 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:13.141120 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:13.141120 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:13.141120 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:13.141120 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:13.141120 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:13.141120 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:52:13.141120 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:52:13.141120 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:52:13.141120 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:52:13.142016 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:52:13.142016 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:52:13.142016 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:52:13.142016 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:52:13.142016 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:13.142016 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:13.142016 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:13.142016 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:13.142016 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:13.142016 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:13.142016 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:13.142016 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:13.142016 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:13.142016 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:13.142016 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:13.142016 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:13.143236 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:13.143236 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:13.143236 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:13.143236 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:13.143236 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:52:13.143236 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:52:13.143236 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:52:13.143236 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:52:13.143236 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:52:13.143236 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:52:13.143236 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:52:13.143236 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:13.143236 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 194/396] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 27 18:52:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:52:13.148189 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae51c0fa-75d8-47de-be12-f4d6fd666ab2 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:13.182429 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:13.273338 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae51c0fa-75d8-47de-be12-f4d6fd666ab2 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:13.317360 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa115a86-69af-492d-a903-8f27665f1f23 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:13.320402 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa31f67-4fb1-4c8b-88f0-7d0c0d5d9393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:13.321017 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa31f67-4fb1-4c8b-88f0-7d0c0d5d9393 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:13.321293 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa31f67-4fb1-4c8b-88f0-7d0c0d5d9393 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:13.321561 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa31f67-4fb1-4c8b-88f0-7d0c0d5d9393 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:13.324219 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa31f67-4fb1-4c8b-88f0-7d0c0d5d9393 None admin] RBAC: Adding query filter params (name=member) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:13.324529 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa31f67-4fb1-4c8b-88f0-7d0c0d5d9393 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:13.325902 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa31f67-4fb1-4c8b-88f0-7d0c0d5d9393 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:13.344235 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 195/397] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 27 18:52:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:52:13.372427 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa31f67-4fb1-4c8b-88f0-7d0c0d5d9393 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:13.388074 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8007b352-1dfc-4c9a-9b48-36da09282006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:13.389610 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007b352-1dfc-4c9a-9b48-36da09282006 None admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:13.389909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007b352-1dfc-4c9a-9b48-36da09282006 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:13.390174 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007b352-1dfc-4c9a-9b48-36da09282006 None admin] PATH_INFO: `/v3/projects/d85bb1f7e9394d898e25c565c5043262/groups/f93c1840227244b0b05a52e3d92fa4ea/roles/448ae448fe9a474ab1166ca18f7ac4d8` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:13.395269 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8007b352-1dfc-4c9a-9b48-36da09282006 None admin] RBAC: Authorizing `identity:create_grant(project_id=d85bb1f7e9394d898e25c565c5043262, group_id=f93c1840227244b0b05a52e3d92fa4ea, role_id=448ae448fe9a474ab1166ca18f7ac4d8)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:13.396753 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8007b352-1dfc-4c9a-9b48-36da09282006 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:13.423719 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 203/398] 10.222.0.20 () {58 vars in 1442 bytes} [Wed Jul 27 18:52:13 2022] PUT /identity/v3/projects/d85bb1f7e9394d898e25c565c5043262/groups/f93c1840227244b0b05a52e3d92fa4ea/roles/448ae448fe9a474ab1166ca18f7ac4d8 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:13.471327 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:13.505135 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa31f67-4fb1-4c8b-88f0-7d0c0d5d9393 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:13.542437 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9093143d-9669-498b-be7e-1e67eb6c0fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:13.543084 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9093143d-9669-498b-be7e-1e67eb6c0fc4 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:13.543362 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9093143d-9669-498b-be7e-1e67eb6c0fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:13.543631 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9093143d-9669-498b-be7e-1e67eb6c0fc4 None admin] PATH_INFO: `/v3/groups/f93c1840227244b0b05a52e3d92fa4ea` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:13.544814 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9093143d-9669-498b-be7e-1e67eb6c0fc4 None admin] RBAC: Authorizing `identity:get_group(group_id=f93c1840227244b0b05a52e3d92fa4ea)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:13.546301 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9093143d-9669-498b-be7e-1e67eb6c0fc4 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:13.548306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 196/399] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Jul 27 18:52:13 2022] GET /identity/v3/groups/f93c1840227244b0b05a52e3d92fa4ea => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:13.553900 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8007b352-1dfc-4c9a-9b48-36da09282006 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:13.620965 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944f399-dcfb-45bb-a5cc-535584b3ddae None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:13.621227 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944f399-dcfb-45bb-a5cc-535584b3ddae None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:13.621618 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944f399-dcfb-45bb-a5cc-535584b3ddae None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:13.623034 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 197/400] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:52:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:52:13.633524 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e24369-7d71-417f-8d0b-50888c5e3b36 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:13.633812 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e24369-7d71-417f-8d0b-50888c5e3b36 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:13.634074 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e24369-7d71-417f-8d0b-50888c5e3b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:13.663383 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-61e24369-7d71-417f-8d0b-50888c5e3b36 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:13.664637 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-61e24369-7d71-417f-8d0b-50888c5e3b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:13.701791 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:13.717073 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8007b352-1dfc-4c9a-9b48-36da09282006 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:13.785774 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 198/401] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:52:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:52:13.803084 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c6e363-c001-4124-b7a6-0cb01122a864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:13.803783 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c6e363-c001-4124-b7a6-0cb01122a864 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:13.804070 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c6e363-c001-4124-b7a6-0cb01122a864 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:13.804349 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c6e363-c001-4124-b7a6-0cb01122a864 None admin] PATH_INFO: `/v3/projects/fb4af7b5833b4b5b84a3c061a2fc98c8` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:13.808266 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c6e363-c001-4124-b7a6-0cb01122a864 None admin] RBAC: Authorizing `identity:get_project(project_id=fb4af7b5833b4b5b84a3c061a2fc98c8)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:13.808742 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e24369-7d71-417f-8d0b-50888c5e3b36 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:13.809720 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c6e363-c001-4124-b7a6-0cb01122a864 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:13.811652 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 204/402] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 27 18:52:13 2022] GET /identity/v3/projects/fb4af7b5833b4b5b84a3c061a2fc98c8 => generated 302 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:13.817125 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c6e363-c001-4124-b7a6-0cb01122a864 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:13.880916 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:13.918179 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e24369-7d71-417f-8d0b-50888c5e3b36 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:13.955419 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b38b215-0ffa-45e5-9691-0cde4c6d31b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:13.956085 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38b215-0ffa-45e5-9691-0cde4c6d31b4 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:13.956360 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38b215-0ffa-45e5-9691-0cde4c6d31b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:13.956741 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38b215-0ffa-45e5-9691-0cde4c6d31b4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:13.967788 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b38b215-0ffa-45e5-9691-0cde4c6d31b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:52:13.972895 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-1b38b215-0ffa-45e5-9691-0cde4c6d31b4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:52:13.972895 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:13.972895 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:13.972895 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:13.972895 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:13.972895 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:13.972895 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:13.972895 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:13.972895 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:13.972895 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:13.972895 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:13.972895 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:13.972895 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:52:13.972895 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:52:13.972895 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:52:13.972895 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:52:13.973757 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:52:13.973757 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:52:13.973757 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:52:13.973757 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:52:13.973757 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:13.973757 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:13.973757 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:13.973757 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:13.973757 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:13.973757 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:13.973757 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:13.973757 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:13.973757 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:13.973757 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:13.973757 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:13.973757 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:13.974554 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:13.974554 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:13.974554 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:13.974554 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:13.974554 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:52:13.974554 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:52:13.974554 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:52:13.974554 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:52:13.974554 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:52:13.974554 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:52:13.974554 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:52:13.974554 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:13.974554 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 199/403] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 27 18:52:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:52:13.980893 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b38b215-0ffa-45e5-9691-0cde4c6d31b4 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:14.035106 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c6e363-c001-4124-b7a6-0cb01122a864 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:14.071307 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12663d4-e750-4812-a7cc-5ed40e4c32ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:14.072045 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12663d4-e750-4812-a7cc-5ed40e4c32ad None admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:14.072360 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12663d4-e750-4812-a7cc-5ed40e4c32ad None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:14.072636 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12663d4-e750-4812-a7cc-5ed40e4c32ad None admin] PATH_INFO: `/v3/projects/fb4af7b5833b4b5b84a3c061a2fc98c8/groups/f93c1840227244b0b05a52e3d92fa4ea/roles/448ae448fe9a474ab1166ca18f7ac4d8` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:14.074672 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12663d4-e750-4812-a7cc-5ed40e4c32ad None admin] RBAC: Authorizing `identity:create_grant(project_id=fb4af7b5833b4b5b84a3c061a2fc98c8, group_id=f93c1840227244b0b05a52e3d92fa4ea, role_id=448ae448fe9a474ab1166ca18f7ac4d8)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:14.076138 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12663d4-e750-4812-a7cc-5ed40e4c32ad None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:14.089141 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b38b215-0ffa-45e5-9691-0cde4c6d31b4 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:14.092561 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 205/404] 10.222.0.20 () {58 vars in 1442 bytes} [Wed Jul 27 18:52:13 2022] PUT /identity/v3/projects/fb4af7b5833b4b5b84a3c061a2fc98c8/groups/f93c1840227244b0b05a52e3d92fa4ea/roles/448ae448fe9a474ab1166ca18f7ac4d8 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:52:14.099922 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417b1bd-81df-400c-b5a1-1d59e2c2b0e3 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:14.100445 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417b1bd-81df-400c-b5a1-1d59e2c2b0e3 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:14.100732 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417b1bd-81df-400c-b5a1-1d59e2c2b0e3 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:14.102660 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 206/405] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:52:14 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:52:14.108669 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2abd8aa-342d-4c71-aac5-32b2af05f947 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:14.109064 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2abd8aa-342d-4c71-aac5-32b2af05f947 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:14.109351 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2abd8aa-342d-4c71-aac5-32b2af05f947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:14.124336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:14.137114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19e452-8eec-410f-b9ee-0d6b3be2f8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:14.137747 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19e452-8eec-410f-b9ee-0d6b3be2f8ea None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:14.139216 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19e452-8eec-410f-b9ee-0d6b3be2f8ea None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:14.139487 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19e452-8eec-410f-b9ee-0d6b3be2f8ea None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:14.141769 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be19e452-8eec-410f-b9ee-0d6b3be2f8ea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:14.142091 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be19e452-8eec-410f-b9ee-0d6b3be2f8ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:14.142492 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-f2abd8aa-342d-4c71-aac5-32b2af05f947 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:14.143513 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be19e452-8eec-410f-b9ee-0d6b3be2f8ea None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:14.143804 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-f2abd8aa-342d-4c71-aac5-32b2af05f947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:14.153341 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 200/406] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 27 18:52:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:14.164252 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:14.165197 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19e452-8eec-410f-b9ee-0d6b3be2f8ea None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:14.245137 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 207/407] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:52:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:52:14.305923 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2abd8aa-342d-4c71-aac5-32b2af05f947 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:14.342345 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19e452-8eec-410f-b9ee-0d6b3be2f8ea None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:14.381265 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a53a9-1160-4fe0-bd10-ac33b76dab01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:14.381904 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a53a9-1160-4fe0-bd10-ac33b76dab01 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:14.382185 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a53a9-1160-4fe0-bd10-ac33b76dab01 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:14.382454 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a53a9-1160-4fe0-bd10-ac33b76dab01 None admin] PATH_INFO: `/v3/groups/f93c1840227244b0b05a52e3d92fa4ea` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:14.383729 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675a53a9-1160-4fe0-bd10-ac33b76dab01 None admin] RBAC: Authorizing `identity:get_group(group_id=f93c1840227244b0b05a52e3d92fa4ea)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:14.385332 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675a53a9-1160-4fe0-bd10-ac33b76dab01 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:14.387105 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 201/408] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Jul 27 18:52:14 2022] GET /identity/v3/groups/f93c1840227244b0b05a52e3d92fa4ea => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:14.394901 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a53a9-1160-4fe0-bd10-ac33b76dab01 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:14.436339 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2abd8aa-342d-4c71-aac5-32b2af05f947 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:14.476049 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:14.485300 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2fde3b-55db-448e-8597-2ec5b9f7573f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:14.486218 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2fde3b-55db-448e-8597-2ec5b9f7573f None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:14.486508 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2fde3b-55db-448e-8597-2ec5b9f7573f None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:14.486778 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2fde3b-55db-448e-8597-2ec5b9f7573f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:14.505319 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2fde3b-55db-448e-8597-2ec5b9f7573f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:52:14.516643 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a53a9-1160-4fe0-bd10-ac33b76dab01 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:14.518881 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-3e2fde3b-55db-448e-8597-2ec5b9f7573f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:52:14.518881 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:14.518881 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:14.518881 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:14.518881 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:14.518881 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:14.518881 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:14.518881 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:14.518881 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:14.518881 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:14.518881 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:14.518881 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:14.518881 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:52:14.518881 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:52:14.518881 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:52:14.518881 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:52:14.519770 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:52:14.519770 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:52:14.519770 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:52:14.519770 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:52:14.519770 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:14.519770 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:14.519770 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:14.519770 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:14.519770 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:14.519770 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:14.519770 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:14.519770 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:14.519770 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:14.519770 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:14.519770 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:14.519770 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:14.520988 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:14.520988 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:14.520988 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:14.520988 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:14.520988 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:52:14.520988 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:52:14.520988 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:52:14.520988 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:52:14.520988 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:52:14.520988 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:52:14.520988 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:52:14.520988 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:14.520988 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 208/409] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 27 18:52:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:52:14.528290 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2fde3b-55db-448e-8597-2ec5b9f7573f None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:14.540071 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:14.555527 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a355dfb-7895-4b7e-83b6-db1286f7954f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:14.556249 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a355dfb-7895-4b7e-83b6-db1286f7954f None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:14.556568 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a355dfb-7895-4b7e-83b6-db1286f7954f None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:14.556846 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a355dfb-7895-4b7e-83b6-db1286f7954f None admin] PATH_INFO: `/v3/projects/fb4af7b5833b4b5b84a3c061a2fc98c8` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:14.558124 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a355dfb-7895-4b7e-83b6-db1286f7954f None admin] RBAC: Authorizing `identity:get_project(project_id=fb4af7b5833b4b5b84a3c061a2fc98c8)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:14.559557 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a355dfb-7895-4b7e-83b6-db1286f7954f None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:14.561588 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 202/410] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 27 18:52:14 2022] GET /identity/v3/projects/fb4af7b5833b4b5b84a3c061a2fc98c8 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:52:14.567150 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a355dfb-7895-4b7e-83b6-db1286f7954f None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:14.674056 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a355dfb-7895-4b7e-83b6-db1286f7954f None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:14.692421 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2fde3b-55db-448e-8597-2ec5b9f7573f None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:14.720178 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:14.731728 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb71f4-ab13-45b2-8f06-6ed403542536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:14.732366 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb71f4-ab13-45b2-8f06-6ed403542536 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:14.732646 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb71f4-ab13-45b2-8f06-6ed403542536 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:14.732918 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb71f4-ab13-45b2-8f06-6ed403542536 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:14.733632 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eb71f4-ab13-45b2-8f06-6ed403542536 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:14.733934 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eb71f4-ab13-45b2-8f06-6ed403542536 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:14.734315 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff50b8a-2363-4636-88fb-e40abd748ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:14.734979 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff50b8a-2363-4636-88fb-e40abd748ea5 None admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:14.735259 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff50b8a-2363-4636-88fb-e40abd748ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:14.735433 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eb71f4-ab13-45b2-8f06-6ed403542536 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:14.735578 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff50b8a-2363-4636-88fb-e40abd748ea5 None admin] PATH_INFO: `/v3/projects/fb4af7b5833b4b5b84a3c061a2fc98c8/groups/f93c1840227244b0b05a52e3d92fa4ea/roles/8d808722e03a4591a59440f170ec672f` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:14.744158 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 209/411] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 27 18:52:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:52:14.745705 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff50b8a-2363-4636-88fb-e40abd748ea5 None admin] RBAC: Authorizing `identity:create_grant(project_id=fb4af7b5833b4b5b84a3c061a2fc98c8, group_id=f93c1840227244b0b05a52e3d92fa4ea, role_id=8d808722e03a4591a59440f170ec672f)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:14.747128 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff50b8a-2363-4636-88fb-e40abd748ea5 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:14.753042 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb71f4-ab13-45b2-8f06-6ed403542536 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:14.772821 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 203/412] 10.222.0.20 () {58 vars in 1442 bytes} [Wed Jul 27 18:52:14 2022] PUT /identity/v3/projects/fb4af7b5833b4b5b84a3c061a2fc98c8/groups/f93c1840227244b0b05a52e3d92fa4ea/roles/8d808722e03a4591a59440f170ec672f => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:14.834006 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:14.873054 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb71f4-ab13-45b2-8f06-6ed403542536 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:14.925882 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e8fbf7-957d-428d-afd8-2ce4cb06d7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:14.926535 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e8fbf7-957d-428d-afd8-2ce4cb06d7bb None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:14.926821 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e8fbf7-957d-428d-afd8-2ce4cb06d7bb None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:14.927145 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e8fbf7-957d-428d-afd8-2ce4cb06d7bb None admin] PATH_INFO: `/v3/groups/f5776c89b13047ba851e307d4eb06864` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:14.932413 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e8fbf7-957d-428d-afd8-2ce4cb06d7bb None admin] RBAC: Authorizing `identity:get_group(group_id=f5776c89b13047ba851e307d4eb06864)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:14.934070 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e8fbf7-957d-428d-afd8-2ce4cb06d7bb None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:14.936185 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 210/413] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Jul 27 18:52:14 2022] GET /identity/v3/groups/f5776c89b13047ba851e307d4eb06864 => generated 229 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:14.941945 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff50b8a-2363-4636-88fb-e40abd748ea5 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:14.985251 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08da6fd-c636-40d3-830f-75da514b2f61 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:14.985561 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08da6fd-c636-40d3-830f-75da514b2f61 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:14.985812 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08da6fd-c636-40d3-830f-75da514b2f61 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:14.987795 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 211/414] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:52:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:52:14.995368 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648faab8-5eef-42b7-8d87-3dfeb2af8782 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:14.995653 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648faab8-5eef-42b7-8d87-3dfeb2af8782 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:14.995995 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648faab8-5eef-42b7-8d87-3dfeb2af8782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:15.019438 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-648faab8-5eef-42b7-8d87-3dfeb2af8782 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:15.022559 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-648faab8-5eef-42b7-8d87-3dfeb2af8782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:15.068601 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff50b8a-2363-4636-88fb-e40abd748ea5 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:15.118637 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 212/415] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:52:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:52:15.126176 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e7dedb-46f3-4a7b-9c9c-ae3936384d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:15.126867 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7dedb-46f3-4a7b-9c9c-ae3936384d1a None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:15.127146 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7dedb-46f3-4a7b-9c9c-ae3936384d1a None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:15.127417 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7dedb-46f3-4a7b-9c9c-ae3936384d1a None admin] PATH_INFO: `/v3/projects/6643b58dd5014772a6237180b96549c9` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:15.132373 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e7dedb-46f3-4a7b-9c9c-ae3936384d1a None admin] RBAC: Authorizing `identity:get_project(project_id=6643b58dd5014772a6237180b96549c9)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:15.133915 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e7dedb-46f3-4a7b-9c9c-ae3936384d1a None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:15.136456 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 204/416] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 27 18:52:14 2022] GET /identity/v3/projects/6643b58dd5014772a6237180b96549c9 => generated 344 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:15.141912 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648faab8-5eef-42b7-8d87-3dfeb2af8782 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:15.174546 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e7dedb-46f3-4a7b-9c9c-ae3936384d1a None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:15.240375 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:15.280840 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:15.289281 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e7dedb-46f3-4a7b-9c9c-ae3936384d1a None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:15.323210 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd740fa2-83fb-41f2-9656-0873f01e9e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:15.323894 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd740fa2-83fb-41f2-9656-0873f01e9e83 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:15.324173 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd740fa2-83fb-41f2-9656-0873f01e9e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:15.324942 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd740fa2-83fb-41f2-9656-0873f01e9e83 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:15.335004 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd740fa2-83fb-41f2-9656-0873f01e9e83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:52:15.341389 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-fd740fa2-83fb-41f2-9656-0873f01e9e83 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:52:15.341389 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:15.341389 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:15.341389 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:15.341389 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:15.341389 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:15.341389 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:15.341389 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:15.341389 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:15.341389 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:15.341389 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:15.341389 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:15.341389 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:52:15.341389 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:52:15.341389 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:52:15.341389 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:52:15.342252 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:52:15.342252 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:52:15.342252 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:52:15.342252 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:52:15.342252 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:15.342252 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:15.342252 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:15.342252 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:15.342252 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:15.342252 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:15.342252 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:15.342252 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:15.342252 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:15.342252 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:15.342252 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:15.342252 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:15.343029 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:15.343029 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:15.343029 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:15.343029 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:15.343029 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:52:15.343029 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:52:15.343029 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:52:15.343029 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:52:15.343029 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:52:15.343029 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:52:15.343029 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:52:15.343029 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:15.343029 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 205/417] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 27 18:52:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:15.348451 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd740fa2-83fb-41f2-9656-0873f01e9e83 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:15.365780 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648faab8-5eef-42b7-8d87-3dfeb2af8782 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:15.426094 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5885977d-5366-42be-bae4-c59014a505b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:15.426770 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885977d-5366-42be-bae4-c59014a505b4 None admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:15.427053 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885977d-5366-42be-bae4-c59014a505b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:15.427332 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885977d-5366-42be-bae4-c59014a505b4 None admin] PATH_INFO: `/v3/projects/6643b58dd5014772a6237180b96549c9/groups/f5776c89b13047ba851e307d4eb06864/roles/0f4a39b061e148418413cfe647af9a34` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:15.430733 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5885977d-5366-42be-bae4-c59014a505b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=6643b58dd5014772a6237180b96549c9, group_id=f5776c89b13047ba851e307d4eb06864, role_id=0f4a39b061e148418413cfe647af9a34)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:15.434158 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5885977d-5366-42be-bae4-c59014a505b4 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:15.455047 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 213/418] 10.222.0.20 () {58 vars in 1442 bytes} [Wed Jul 27 18:52:15 2022] PUT /identity/v3/projects/6643b58dd5014772a6237180b96549c9/groups/f5776c89b13047ba851e307d4eb06864/roles/0f4a39b061e148418413cfe647af9a34 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:15.524744 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd740fa2-83fb-41f2-9656-0873f01e9e83 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:15.573798 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:15.602014 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74420bb3-fd23-492b-a9dd-9037ad816ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:15.602640 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74420bb3-fd23-492b-a9dd-9037ad816ce6 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:15.602924 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74420bb3-fd23-492b-a9dd-9037ad816ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:15.603199 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74420bb3-fd23-492b-a9dd-9037ad816ce6 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:15.604024 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74420bb3-fd23-492b-a9dd-9037ad816ce6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:15.604334 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74420bb3-fd23-492b-a9dd-9037ad816ce6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:15.605724 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74420bb3-fd23-492b-a9dd-9037ad816ce6 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:15.619822 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 206/419] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 27 18:52:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:15.625451 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5885977d-5366-42be-bae4-c59014a505b4 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:15.734540 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5885977d-5366-42be-bae4-c59014a505b4 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:15.764848 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:15.780938 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f2be87-3457-47fd-b8b1-1054f5609aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:15.781542 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2be87-3457-47fd-b8b1-1054f5609aaf None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:15.781825 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2be87-3457-47fd-b8b1-1054f5609aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:15.782150 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2be87-3457-47fd-b8b1-1054f5609aaf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:15.871650 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f2be87-3457-47fd-b8b1-1054f5609aaf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:15.873129 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f2be87-3457-47fd-b8b1-1054f5609aaf None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:16.001299 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 214/420] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 27 18:52:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:52:16.006518 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74420bb3-fd23-492b-a9dd-9037ad816ce6 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:16.142513 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74420bb3-fd23-492b-a9dd-9037ad816ce6 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:16.179945 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce73bb-a47e-4d7d-a8f1-a9e79c06e140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:16.180593 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce73bb-a47e-4d7d-a8f1-a9e79c06e140 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:16.180886 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce73bb-a47e-4d7d-a8f1-a9e79c06e140 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:16.181158 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce73bb-a47e-4d7d-a8f1-a9e79c06e140 None admin] PATH_INFO: `/v3/projects/d85bb1f7e9394d898e25c565c5043262` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:16.182391 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ce73bb-a47e-4d7d-a8f1-a9e79c06e140 None admin] RBAC: Authorizing `identity:get_project(project_id=d85bb1f7e9394d898e25c565c5043262)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:16.183854 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ce73bb-a47e-4d7d-a8f1-a9e79c06e140 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:16.185828 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 207/421] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 27 18:52:16 2022] GET /identity/v3/projects/d85bb1f7e9394d898e25c565c5043262 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:16.191349 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f2be87-3457-47fd-b8b1-1054f5609aaf None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:16.219972 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:16.226415 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25696ba-3554-4754-93da-5c536773ef2c None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:16.226706 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25696ba-3554-4754-93da-5c536773ef2c None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:16.226982 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25696ba-3554-4754-93da-5c536773ef2c None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:16.228716 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 208/422] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:52:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:52:16.241760 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0f7c9-8e08-4289-aadd-d67185994b8f None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:16.242048 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0f7c9-8e08-4289-aadd-d67185994b8f None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:16.242339 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0f7c9-8e08-4289-aadd-d67185994b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:16.270284 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-a6c0f7c9-8e08-4289-aadd-d67185994b8f None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:16.271480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-a6c0f7c9-8e08-4289-aadd-d67185994b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:16.327922 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f2be87-3457-47fd-b8b1-1054f5609aaf None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:16.356086 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:16.387364 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0646a2-fec9-4fed-ab9a-47fcae529d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:16.388043 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0646a2-fec9-4fed-ab9a-47fcae529d43 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:16.388331 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0646a2-fec9-4fed-ab9a-47fcae529d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:16.388609 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0646a2-fec9-4fed-ab9a-47fcae529d43 None admin] PATH_INFO: `/v3/groups/f93c1840227244b0b05a52e3d92fa4ea` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:16.389914 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0646a2-fec9-4fed-ab9a-47fcae529d43 None admin] RBAC: Authorizing `identity:get_group(group_id=f93c1840227244b0b05a52e3d92fa4ea)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:16.391364 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0646a2-fec9-4fed-ab9a-47fcae529d43 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:16.395167 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 215/423] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Jul 27 18:52:16 2022] GET /identity/v3/groups/f93c1840227244b0b05a52e3d92fa4ea => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:16.401341 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0646a2-fec9-4fed-ab9a-47fcae529d43 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:16.407448 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 209/424] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:52:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:52:16.443626 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c0f7c9-8e08-4289-aadd-d67185994b8f None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:16.534434 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:16.541988 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0646a2-fec9-4fed-ab9a-47fcae529d43 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:16.579506 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af8350-875f-4ea9-85cf-3718b184c0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:16.580394 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af8350-875f-4ea9-85cf-3718b184c0de None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:16.580819 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af8350-875f-4ea9-85cf-3718b184c0de None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:16.581235 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af8350-875f-4ea9-85cf-3718b184c0de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:16.582184 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2af8350-875f-4ea9-85cf-3718b184c0de None admin] RBAC: Adding query filter params (group.id=f93c1840227244b0b05a52e3d92fa4ea, role.id=8d808722e03a4591a59440f170ec672f, scope.project.id=d85bb1f7e9394d898e25c565c5043262) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:16.582656 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2af8350-875f-4ea9-85cf-3718b184c0de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:16.584259 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2af8350-875f-4ea9-85cf-3718b184c0de None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:16.591312 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 216/425] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Jul 27 18:52:16 2022] GET /identity/v3/role_assignments?group.id=f93c1840227244b0b05a52e3d92fa4ea&scope.project.id=d85bb1f7e9394d898e25c565c5043262&role.id=8d808722e03a4591a59440f170ec672f => generated 611 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:16.682746 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c0f7c9-8e08-4289-aadd-d67185994b8f None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:16.743528 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d634e-c805-4452-9446-4d8e2085d356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:16.744273 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d634e-c805-4452-9446-4d8e2085d356 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:16.744551 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d634e-c805-4452-9446-4d8e2085d356 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:16.744822 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d634e-c805-4452-9446-4d8e2085d356 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:16.767729 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3d634e-c805-4452-9446-4d8e2085d356 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:52:16.772588 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-fb3d634e-c805-4452-9446-4d8e2085d356 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:52:16.772588 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:16.772588 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:16.772588 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:16.772588 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:16.772588 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:16.772588 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:16.772588 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:16.772588 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:16.772588 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:16.772588 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:16.772588 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:16.772588 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:52:16.772588 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:52:16.772588 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:52:16.772588 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:52:16.773501 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:52:16.773501 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:52:16.773501 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:52:16.773501 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:52:16.773501 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:16.773501 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:16.773501 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:16.773501 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:16.773501 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:16.773501 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:16.773501 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:16.773501 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:16.773501 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:16.773501 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:16.773501 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:16.773501 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:16.774294 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:16.774294 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:16.774294 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:16.774294 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:16.774294 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:52:16.774294 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:52:16.774294 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:52:16.774294 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:52:16.774294 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:52:16.774294 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:52:16.774294 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:52:16.774294 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:16.774294 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 210/426] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 27 18:52:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:52:16.780253 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af8350-875f-4ea9-85cf-3718b184c0de None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:16.898413 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af8350-875f-4ea9-85cf-3718b184c0de None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:16.939503 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0bdd9d-3d5c-4bdc-a5d0-7be516bd5c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:16.940082 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0bdd9d-3d5c-4bdc-a5d0-7be516bd5c85 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:16.940364 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0bdd9d-3d5c-4bdc-a5d0-7be516bd5c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:16.940637 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0bdd9d-3d5c-4bdc-a5d0-7be516bd5c85 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:16.941363 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0bdd9d-3d5c-4bdc-a5d0-7be516bd5c85 None admin] RBAC: Adding query filter params (name=member) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:16.941669 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0bdd9d-3d5c-4bdc-a5d0-7be516bd5c85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:16.943050 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0bdd9d-3d5c-4bdc-a5d0-7be516bd5c85 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:16.953911 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 217/427] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 27 18:52:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:16.959065 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d634e-c805-4452-9446-4d8e2085d356 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:17.005212 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:17.075937 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d634e-c805-4452-9446-4d8e2085d356 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:17.115842 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc8ec1-9012-4b9a-aab6-7d3912615dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:17.116462 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc8ec1-9012-4b9a-aab6-7d3912615dfc None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:17.116744 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc8ec1-9012-4b9a-aab6-7d3912615dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:17.117014 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc8ec1-9012-4b9a-aab6-7d3912615dfc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:17.134336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a9dcc-bb5d-46b6-8b4c-d3a1b0cc55ae None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:17.135554 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a9dcc-bb5d-46b6-8b4c-d3a1b0cc55ae None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:17.137963 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a9dcc-bb5d-46b6-8b4c-d3a1b0cc55ae None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:17.143725 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 218/428] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:52:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:52:17.145851 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f109c5-e372-4598-9cdb-f668ed7a66ee None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:17.146484 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f109c5-e372-4598-9cdb-f668ed7a66ee None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:17.147300 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f109c5-e372-4598-9cdb-f668ed7a66ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:17.173414 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-a7f109c5-e372-4598-9cdb-f668ed7a66ee None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:17.175448 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a7f109c5-e372-4598-9cdb-f668ed7a66ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:17.191280 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cc8ec1-9012-4b9a-aab6-7d3912615dfc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:17.192452 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:17.193041 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cc8ec1-9012-4b9a-aab6-7d3912615dfc None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:17.234611 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:17.254766 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 219/429] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:52:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:52:17.256482 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cfe4d8-757c-400e-8957-0aef4a177e40 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:17.257203 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cfe4d8-757c-400e-8957-0aef4a177e40 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:17.257900 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cfe4d8-757c-400e-8957-0aef4a177e40 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:17.260561 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 220/430] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:52:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:52:17.265224 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dfcf0a-8e13-4cc2-91d5-c51cbcaf6659 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:17.265514 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dfcf0a-8e13-4cc2-91d5-c51cbcaf6659 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:17.265788 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dfcf0a-8e13-4cc2-91d5-c51cbcaf6659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:17.287100 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-b4dfcf0a-8e13-4cc2-91d5-c51cbcaf6659 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:17.288315 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-b4dfcf0a-8e13-4cc2-91d5-c51cbcaf6659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:17.309253 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 211/431] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 27 18:52:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:52:17.310219 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc8ec1-9012-4b9a-aab6-7d3912615dfc None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:17.360718 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 221/432] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:52:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:52:17.373187 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dfcf0a-8e13-4cc2-91d5-c51cbcaf6659 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:17.422713 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc8ec1-9012-4b9a-aab6-7d3912615dfc None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:17.459468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc93667-b08c-4a99-8c65-5448b232b655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:17.460362 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc93667-b08c-4a99-8c65-5448b232b655 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:17.460818 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc93667-b08c-4a99-8c65-5448b232b655 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:17.461084 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc93667-b08c-4a99-8c65-5448b232b655 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:17.463188 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:17.465987 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:17.473339 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc93667-b08c-4a99-8c65-5448b232b655 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:52:17.478845 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-0fc93667-b08c-4a99-8c65-5448b232b655 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:52:17.478845 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:17.478845 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:17.478845 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:17.478845 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:17.478845 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:17.478845 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:17.478845 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:17.478845 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:17.478845 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:17.478845 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:17.478845 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:17.478845 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:52:17.478845 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:52:17.478845 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:52:17.478845 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:52:17.479909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:52:17.479909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:52:17.479909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:52:17.479909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:52:17.479909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:17.479909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:17.479909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:17.479909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:17.479909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:17.479909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:17.479909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:17.479909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:17.479909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:17.479909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:17.479909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:17.479909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:17.480825 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:17.480825 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:17.480825 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:17.480825 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:17.480825 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:52:17.480825 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:52:17.480825 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:52:17.480825 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:52:17.480825 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:52:17.480825 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:52:17.480825 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:52:17.480825 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:17.482969 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 212/433] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 27 18:52:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:17.484025 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc93667-b08c-4a99-8c65-5448b232b655 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:17.490500 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dfcf0a-8e13-4cc2-91d5-c51cbcaf6659 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:17.532079 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe0c09-5c42-4f9f-987f-3315861c0ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:17.532448 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe0c09-5c42-4f9f-987f-3315861c0ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:17.532892 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe0c09-5c42-4f9f-987f-3315861c0ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:17.533175 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe0c09-5c42-4f9f-987f-3315861c0ed7 None admin] PATH_INFO: `/v3/projects/d85bb1f7e9394d898e25c565c5043262` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:17.534734 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbe0c09-5c42-4f9f-987f-3315861c0ed7 None admin] RBAC: Authorizing `identity:get_project(project_id=d85bb1f7e9394d898e25c565c5043262)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:17.536200 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbe0c09-5c42-4f9f-987f-3315861c0ed7 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:17.538038 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 222/434] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 27 18:52:17 2022] GET /identity/v3/projects/d85bb1f7e9394d898e25c565c5043262 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:17.538601 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe0c09-5c42-4f9f-987f-3315861c0ed7 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:17.595906 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc93667-b08c-4a99-8c65-5448b232b655 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:17.637816 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d6ee8-e32b-478c-8cc0-7befe365a8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:17.638581 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d6ee8-e32b-478c-8cc0-7befe365a8d6 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:17.638942 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d6ee8-e32b-478c-8cc0-7befe365a8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:17.639214 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d6ee8-e32b-478c-8cc0-7befe365a8d6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:17.642441 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe0c09-5c42-4f9f-987f-3315861c0ed7 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:17.650073 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84d6ee8-e32b-478c-8cc0-7befe365a8d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:52:17.655447 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-c84d6ee8-e32b-478c-8cc0-7befe365a8d6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:52:17.655447 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:17.655447 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:17.655447 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:17.655447 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:17.655447 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:17.655447 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:17.655447 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:17.655447 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:17.655447 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:17.655447 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:17.655447 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:17.655447 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:52:17.655447 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:52:17.655447 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:52:17.655447 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:52:17.656491 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:52:17.656491 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:52:17.656491 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:52:17.656491 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:52:17.656491 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:17.656491 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:17.656491 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:17.656491 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:17.656491 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:17.656491 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:17.656491 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:17.656491 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:17.656491 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:17.656491 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:17.656491 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:17.656491 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:17.657292 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:17.657292 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:17.657292 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:17.657292 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:17.657292 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:52:17.657292 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:52:17.657292 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:52:17.657292 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:52:17.657292 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:52:17.657292 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:52:17.657292 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:52:17.657292 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:17.657292 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 213/435] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 27 18:52:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:17.657947 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d6ee8-e32b-478c-8cc0-7befe365a8d6 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:17.685054 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38286219-c3a8-4002-9c0d-60abfe782856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:17.685672 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38286219-c3a8-4002-9c0d-60abfe782856 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:17.685958 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38286219-c3a8-4002-9c0d-60abfe782856 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:17.686230 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38286219-c3a8-4002-9c0d-60abfe782856 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:17.686944 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38286219-c3a8-4002-9c0d-60abfe782856 None admin] RBAC: Adding query filter params (name=member) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:17.687246 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38286219-c3a8-4002-9c0d-60abfe782856 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:17.688645 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38286219-c3a8-4002-9c0d-60abfe782856 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:17.696901 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 223/436] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 27 18:52:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:17.702456 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38286219-c3a8-4002-9c0d-60abfe782856 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:17.715009 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:17.719585 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:17.773429 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d6ee8-e32b-478c-8cc0-7befe365a8d6 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:17.812416 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99688a-ca00-4bf8-9326-59fecfcd8917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:17.813068 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99688a-ca00-4bf8-9326-59fecfcd8917 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:17.813352 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99688a-ca00-4bf8-9326-59fecfcd8917 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:17.813629 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99688a-ca00-4bf8-9326-59fecfcd8917 None admin] PATH_INFO: `/v3/groups/f93c1840227244b0b05a52e3d92fa4ea` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:17.814801 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99688a-ca00-4bf8-9326-59fecfcd8917 None admin] RBAC: Authorizing `identity:get_group(group_id=f93c1840227244b0b05a52e3d92fa4ea)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:17.815117 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38286219-c3a8-4002-9c0d-60abfe782856 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:17.816284 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99688a-ca00-4bf8-9326-59fecfcd8917 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:17.818190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 214/437] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Jul 27 18:52:17 2022] GET /identity/v3/groups/f93c1840227244b0b05a52e3d92fa4ea => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:17.818645 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99688a-ca00-4bf8-9326-59fecfcd8917 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:17.849675 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5854e0d9-6ffb-4e11-b4a8-9a0300c282e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:17.850293 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5854e0d9-6ffb-4e11-b4a8-9a0300c282e0 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:17.850577 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5854e0d9-6ffb-4e11-b4a8-9a0300c282e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:17.850852 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5854e0d9-6ffb-4e11-b4a8-9a0300c282e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:17.851569 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5854e0d9-6ffb-4e11-b4a8-9a0300c282e0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:17.851909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5854e0d9-6ffb-4e11-b4a8-9a0300c282e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:17.853285 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5854e0d9-6ffb-4e11-b4a8-9a0300c282e0 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:17.861362 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 224/438] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 27 18:52:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:17.862646 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d743f-981b-4c99-bb59-2f8469067ebe None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:17.862941 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d743f-981b-4c99-bb59-2f8469067ebe None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:17.863219 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d743f-981b-4c99-bb59-2f8469067ebe None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:17.866101 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 225/439] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:52:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:52:17.866101 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9d743f-981b-4c99-bb59-2f8469067ebe None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:17.919195 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99688a-ca00-4bf8-9326-59fecfcd8917 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:17.935926 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:17.940985 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:17.953443 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8947ad-68e3-4c60-a3a5-26c077c4b040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:17.954050 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8947ad-68e3-4c60-a3a5-26c077c4b040 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:17.954332 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8947ad-68e3-4c60-a3a5-26c077c4b040 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:17.954611 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8947ad-68e3-4c60-a3a5-26c077c4b040 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:17.967500 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9d743f-981b-4c99-bb59-2f8469067ebe None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:18.003824 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c03d4-0166-48dc-8d49-92d393ec9f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:18.004732 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c03d4-0166-48dc-8d49-92d393ec9f94 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:18.005153 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c03d4-0166-48dc-8d49-92d393ec9f94 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:18.005569 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c03d4-0166-48dc-8d49-92d393ec9f94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:18.006800 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5c03d4-0166-48dc-8d49-92d393ec9f94 None admin] RBAC: Adding query filter params (group.id=f93c1840227244b0b05a52e3d92fa4ea, role.id=448ae448fe9a474ab1166ca18f7ac4d8, scope.project.id=d85bb1f7e9394d898e25c565c5043262) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:18.007274 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5c03d4-0166-48dc-8d49-92d393ec9f94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:18.010077 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5c03d4-0166-48dc-8d49-92d393ec9f94 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:18.020801 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 226/440] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Jul 27 18:52:17 2022] GET /identity/v3/role_assignments?group.id=f93c1840227244b0b05a52e3d92fa4ea&scope.project.id=d85bb1f7e9394d898e25c565c5043262&role.id=448ae448fe9a474ab1166ca18f7ac4d8 => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:18.020801 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c03d4-0166-48dc-8d49-92d393ec9f94 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:18.031037 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8947ad-68e3-4c60-a3a5-26c077c4b040 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:18.032575 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8947ad-68e3-4c60-a3a5-26c077c4b040 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:18.142597 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c03d4-0166-48dc-8d49-92d393ec9f94 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:18.156378 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 215/441] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 27 18:52:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:52:18.156378 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19468b8-9d3a-49b0-b01a-4d990f8a1d1d None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:18.156378 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19468b8-9d3a-49b0-b01a-4d990f8a1d1d None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:18.156378 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19468b8-9d3a-49b0-b01a-4d990f8a1d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:18.172790 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-e19468b8-9d3a-49b0-b01a-4d990f8a1d1d None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:18.173990 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-e19468b8-9d3a-49b0-b01a-4d990f8a1d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:18.187461 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c806b1fd-3006-4d72-9e2f-db73947e97fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:18.188112 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806b1fd-3006-4d72-9e2f-db73947e97fb None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:18.188391 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806b1fd-3006-4d72-9e2f-db73947e97fb None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:18.188658 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806b1fd-3006-4d72-9e2f-db73947e97fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:18.192068 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:18.192385 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:18.254259 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 216/442] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:52:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:52:18.255388 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19468b8-9d3a-49b0-b01a-4d990f8a1d1d None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:18.272007 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c806b1fd-3006-4d72-9e2f-db73947e97fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:18.273465 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c806b1fd-3006-4d72-9e2f-db73947e97fb None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:18.387071 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19468b8-9d3a-49b0-b01a-4d990f8a1d1d None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:18.402882 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 227/443] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 27 18:52:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:52:18.407827 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c806b1fd-3006-4d72-9e2f-db73947e97fb None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:18.433584 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cde9c05-d57d-4c3e-910e-9adab1f580b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:18.434232 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde9c05-d57d-4c3e-910e-9adab1f580b5 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:18.434953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde9c05-d57d-4c3e-910e-9adab1f580b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:18.434953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde9c05-d57d-4c3e-910e-9adab1f580b5 None admin] PATH_INFO: `/v3/projects/fb4af7b5833b4b5b84a3c061a2fc98c8` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:18.438860 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cde9c05-d57d-4c3e-910e-9adab1f580b5 None admin] RBAC: Authorizing `identity:get_project(project_id=fb4af7b5833b4b5b84a3c061a2fc98c8)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:18.440471 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cde9c05-d57d-4c3e-910e-9adab1f580b5 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:18.442128 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 217/444] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 27 18:52:18 2022] GET /identity/v3/projects/fb4af7b5833b4b5b84a3c061a2fc98c8 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:18.442873 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cde9c05-d57d-4c3e-910e-9adab1f580b5 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:18.451444 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:18.469694 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:18.528120 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c806b1fd-3006-4d72-9e2f-db73947e97fb None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:18.565449 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549aacb-1638-4171-96ff-e4f4c329a731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:18.566085 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549aacb-1638-4171-96ff-e4f4c329a731 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:18.566351 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549aacb-1638-4171-96ff-e4f4c329a731 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:18.566686 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549aacb-1638-4171-96ff-e4f4c329a731 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:18.566791 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cde9c05-d57d-4c3e-910e-9adab1f580b5 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:18.576435 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0549aacb-1638-4171-96ff-e4f4c329a731 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:52:18.581290 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-0549aacb-1638-4171-96ff-e4f4c329a731 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:52:18.581290 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:18.581290 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:18.581290 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:18.581290 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:18.581290 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:18.581290 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:18.581290 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:18.581290 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:18.581290 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:18.581290 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:18.581290 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:18.581290 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:52:18.581290 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:52:18.581290 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:52:18.581290 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:52:18.582461 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:52:18.582461 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:52:18.582461 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:52:18.582461 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:52:18.582461 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:18.582461 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:18.582461 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:18.582461 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:18.582461 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:18.582461 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:18.582461 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:18.582461 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:18.582461 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:18.582461 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:18.582461 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:18.582461 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:18.583644 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:18.583644 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:18.583644 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:18.583644 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:18.583644 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:52:18.583644 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:52:18.583644 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:52:18.583644 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:52:18.583644 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:52:18.583644 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:52:18.583644 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:52:18.583644 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:18.583644 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 228/445] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 27 18:52:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:18.583644 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549aacb-1638-4171-96ff-e4f4c329a731 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:18.602955 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0938873-d205-42b0-b99a-42d580d8c5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:18.604163 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0938873-d205-42b0-b99a-42d580d8c5d6 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:18.604440 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0938873-d205-42b0-b99a-42d580d8c5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:18.604709 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0938873-d205-42b0-b99a-42d580d8c5d6 None admin] PATH_INFO: `/v3/projects/fb4af7b5833b4b5b84a3c061a2fc98c8` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:18.605853 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0938873-d205-42b0-b99a-42d580d8c5d6 None admin] RBAC: Authorizing `identity:get_project(project_id=fb4af7b5833b4b5b84a3c061a2fc98c8)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:18.607270 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0938873-d205-42b0-b99a-42d580d8c5d6 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:18.608938 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 218/446] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 27 18:52:18 2022] GET /identity/v3/projects/fb4af7b5833b4b5b84a3c061a2fc98c8 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:18.609683 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0938873-d205-42b0-b99a-42d580d8c5d6 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:18.677478 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:18.684367 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549aacb-1638-4171-96ff-e4f4c329a731 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:18.695288 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:18.707187 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0938873-d205-42b0-b99a-42d580d8c5d6 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:18.718216 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf6ca83-f7e2-4841-8e75-8defd02ffbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:18.718850 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6ca83-f7e2-4841-8e75-8defd02ffbd1 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:18.719130 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6ca83-f7e2-4841-8e75-8defd02ffbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:18.719403 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6ca83-f7e2-4841-8e75-8defd02ffbd1 None admin] PATH_INFO: `/v3/groups/f93c1840227244b0b05a52e3d92fa4ea` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:18.720579 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf6ca83-f7e2-4841-8e75-8defd02ffbd1 None admin] RBAC: Authorizing `identity:get_group(group_id=f93c1840227244b0b05a52e3d92fa4ea)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:18.722005 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf6ca83-f7e2-4841-8e75-8defd02ffbd1 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:18.723568 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 229/447] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Jul 27 18:52:18 2022] GET /identity/v3/groups/f93c1840227244b0b05a52e3d92fa4ea => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:18.724349 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf6ca83-f7e2-4841-8e75-8defd02ffbd1 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:18.746234 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b9e0a-5e8e-4673-93c8-e6c5e8f69904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:18.746838 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b9e0a-5e8e-4673-93c8-e6c5e8f69904 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:18.747120 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b9e0a-5e8e-4673-93c8-e6c5e8f69904 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:18.747391 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b9e0a-5e8e-4673-93c8-e6c5e8f69904 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:18.748139 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688b9e0a-5e8e-4673-93c8-e6c5e8f69904 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:18.748445 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688b9e0a-5e8e-4673-93c8-e6c5e8f69904 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:18.749808 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688b9e0a-5e8e-4673-93c8-e6c5e8f69904 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:18.757710 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 219/448] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 27 18:52:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:18.758755 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b9e0a-5e8e-4673-93c8-e6c5e8f69904 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:18.825308 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf6ca83-f7e2-4841-8e75-8defd02ffbd1 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:18.854321 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b9e0a-5e8e-4673-93c8-e6c5e8f69904 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:18.858580 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604dc888-bd3a-43b9-a290-a21b102ec2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:18.859225 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604dc888-bd3a-43b9-a290-a21b102ec2d0 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:18.859511 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604dc888-bd3a-43b9-a290-a21b102ec2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:18.859811 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604dc888-bd3a-43b9-a290-a21b102ec2d0 None admin] PATH_INFO: `/v3/groups/f93c1840227244b0b05a52e3d92fa4ea` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:18.861225 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604dc888-bd3a-43b9-a290-a21b102ec2d0 None admin] RBAC: Authorizing `identity:get_group(group_id=f93c1840227244b0b05a52e3d92fa4ea)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:18.862649 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604dc888-bd3a-43b9-a290-a21b102ec2d0 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:18.864267 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 230/449] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Jul 27 18:52:18 2022] GET /identity/v3/groups/f93c1840227244b0b05a52e3d92fa4ea => generated 226 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:18.865019 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604dc888-bd3a-43b9-a290-a21b102ec2d0 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:18.892653 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0154e343-371a-4244-bc68-3b07f89d985d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:18.893262 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154e343-371a-4244-bc68-3b07f89d985d None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:18.893545 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154e343-371a-4244-bc68-3b07f89d985d None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:18.893814 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154e343-371a-4244-bc68-3b07f89d985d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:18.894599 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0154e343-371a-4244-bc68-3b07f89d985d None admin] RBAC: Adding query filter params (group.id=f93c1840227244b0b05a52e3d92fa4ea, role.id=448ae448fe9a474ab1166ca18f7ac4d8, scope.project.id=fb4af7b5833b4b5b84a3c061a2fc98c8) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:18.894909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0154e343-371a-4244-bc68-3b07f89d985d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:18.895202 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:18.896390 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0154e343-371a-4244-bc68-3b07f89d985d None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:18.902682 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 220/450] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Jul 27 18:52:18 2022] GET /identity/v3/role_assignments?group.id=f93c1840227244b0b05a52e3d92fa4ea&scope.project.id=fb4af7b5833b4b5b84a3c061a2fc98c8&role.id=448ae448fe9a474ab1166ca18f7ac4d8 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:18.903463 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0154e343-371a-4244-bc68-3b07f89d985d None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:18.927883 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:18.973419 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604dc888-bd3a-43b9-a290-a21b102ec2d0 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:19.009264 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1159fe-6cee-436b-8f81-4ddad4da771f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:19.009942 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1159fe-6cee-436b-8f81-4ddad4da771f None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:19.010225 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1159fe-6cee-436b-8f81-4ddad4da771f None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:19.010499 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1159fe-6cee-436b-8f81-4ddad4da771f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:19.027481 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0154e343-371a-4244-bc68-3b07f89d985d None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:19.068404 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2239b00d-4d76-49a5-a26a-0f4d1b5f6af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:19.069012 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239b00d-4d76-49a5-a26a-0f4d1b5f6af7 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:19.069289 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239b00d-4d76-49a5-a26a-0f4d1b5f6af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:19.069551 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239b00d-4d76-49a5-a26a-0f4d1b5f6af7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:19.070692 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2239b00d-4d76-49a5-a26a-0f4d1b5f6af7 None admin] RBAC: Adding query filter params (group.id=f93c1840227244b0b05a52e3d92fa4ea, role.id=8d808722e03a4591a59440f170ec672f, scope.project.id=fb4af7b5833b4b5b84a3c061a2fc98c8) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:19.070692 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2239b00d-4d76-49a5-a26a-0f4d1b5f6af7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:19.072195 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2239b00d-4d76-49a5-a26a-0f4d1b5f6af7 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:19.079356 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 221/451] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Jul 27 18:52:18 2022] GET /identity/v3/role_assignments?group.id=f93c1840227244b0b05a52e3d92fa4ea&scope.project.id=fb4af7b5833b4b5b84a3c061a2fc98c8&role.id=8d808722e03a4591a59440f170ec672f => generated 611 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:19.087331 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1159fe-6cee-436b-8f81-4ddad4da771f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:19.089473 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1159fe-6cee-436b-8f81-4ddad4da771f None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:19.129498 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:19.212313 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 231/452] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 27 18:52:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:52:19.219667 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2239b00d-4d76-49a5-a26a-0f4d1b5f6af7 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:19.307488 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:19.329794 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2239b00d-4d76-49a5-a26a-0f4d1b5f6af7 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:19.363308 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81974de1-48cf-4930-b2ba-0d2e57b1d98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:19.363980 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81974de1-48cf-4930-b2ba-0d2e57b1d98d None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:19.364265 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81974de1-48cf-4930-b2ba-0d2e57b1d98d None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:19.364542 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81974de1-48cf-4930-b2ba-0d2e57b1d98d None admin] PATH_INFO: `/v3/projects/6643b58dd5014772a6237180b96549c9` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:19.365715 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81974de1-48cf-4930-b2ba-0d2e57b1d98d None admin] RBAC: Authorizing `identity:get_project(project_id=6643b58dd5014772a6237180b96549c9)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:19.367143 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81974de1-48cf-4930-b2ba-0d2e57b1d98d None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:19.368869 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 222/453] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 27 18:52:19 2022] GET /identity/v3/projects/6643b58dd5014772a6237180b96549c9 => generated 344 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:19.374552 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1159fe-6cee-436b-8f81-4ddad4da771f None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:19.473674 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1159fe-6cee-436b-8f81-4ddad4da771f None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:19.502566 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:19.507766 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46b2c2-0f37-4be1-8413-831c8da1f0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:19.508404 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46b2c2-0f37-4be1-8413-831c8da1f0d2 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:19.508688 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46b2c2-0f37-4be1-8413-831c8da1f0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:19.508963 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46b2c2-0f37-4be1-8413-831c8da1f0d2 None admin] PATH_INFO: `/v3/groups/f5776c89b13047ba851e307d4eb06864` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:19.510144 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad46b2c2-0f37-4be1-8413-831c8da1f0d2 None admin] RBAC: Authorizing `identity:get_group(group_id=f5776c89b13047ba851e307d4eb06864)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:19.511556 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad46b2c2-0f37-4be1-8413-831c8da1f0d2 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:19.513163 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 232/454] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Jul 27 18:52:19 2022] GET /identity/v3/groups/f5776c89b13047ba851e307d4eb06864 => generated 229 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:19.518951 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81974de1-48cf-4930-b2ba-0d2e57b1d98d None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:19.615554 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81974de1-48cf-4930-b2ba-0d2e57b1d98d None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:19.646923 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ace29-74df-4b19-a54f-43ba48a31fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:19.647516 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ace29-74df-4b19-a54f-43ba48a31fc7 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:19.647823 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ace29-74df-4b19-a54f-43ba48a31fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:19.648097 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ace29-74df-4b19-a54f-43ba48a31fc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:19.648876 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ace29-74df-4b19-a54f-43ba48a31fc7 None admin] RBAC: Adding query filter params (group.id=f5776c89b13047ba851e307d4eb06864, role.id=0f4a39b061e148418413cfe647af9a34, scope.project.id=6643b58dd5014772a6237180b96549c9) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:19.649185 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ace29-74df-4b19-a54f-43ba48a31fc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:19.651100 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ace29-74df-4b19-a54f-43ba48a31fc7 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:19.656660 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 223/455] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Jul 27 18:52:19 2022] GET /identity/v3/role_assignments?group.id=f5776c89b13047ba851e307d4eb06864&scope.project.id=6643b58dd5014772a6237180b96549c9&role.id=0f4a39b061e148418413cfe647af9a34 => generated 611 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:21.990372 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024fb739-1550-4f2a-a065-fae0eb3cd018 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:21.990896 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024fb739-1550-4f2a-a065-fae0eb3cd018 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:21.990896 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024fb739-1550-4f2a-a065-fae0eb3cd018 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:21.992514 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 233/456] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:52:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:52:22.000898 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae50390-32d1-4501-9319-bfc46e9c2dd2 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:22.001817 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae50390-32d1-4501-9319-bfc46e9c2dd2 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:22.002293 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae50390-32d1-4501-9319-bfc46e9c2dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:22.032680 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-dae50390-32d1-4501-9319-bfc46e9c2dd2 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:22.034217 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-dae50390-32d1-4501-9319-bfc46e9c2dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:22.037419 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:22.134938 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 224/457] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:52:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:52:22.162534 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024fb739-1550-4f2a-a065-fae0eb3cd018 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:22.232229 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04a1ba-0e07-426f-aa37-056c447f58f1 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:22.232741 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04a1ba-0e07-426f-aa37-056c447f58f1 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:22.233157 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04a1ba-0e07-426f-aa37-056c447f58f1 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:22.234860 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 225/458] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:52:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:52:22.240343 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a0e2d-aa75-4e29-ad6b-c319e04af86f None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:22.240848 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a0e2d-aa75-4e29-ad6b-c319e04af86f None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:22.241264 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a0e2d-aa75-4e29-ad6b-c319e04af86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:22.284678 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-e21a0e2d-aa75-4e29-ad6b-c319e04af86f None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:22.286103 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-e21a0e2d-aa75-4e29-ad6b-c319e04af86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:22.303388 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024fb739-1550-4f2a-a065-fae0eb3cd018 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:22.374720 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be3a7a-ae38-4212-8bde-88dd4d299530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:22.375366 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be3a7a-ae38-4212-8bde-88dd4d299530 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:22.375649 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be3a7a-ae38-4212-8bde-88dd4d299530 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:22.375952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be3a7a-ae38-4212-8bde-88dd4d299530 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:22.386928 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be3a7a-ae38-4212-8bde-88dd4d299530 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:22.388429 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be3a7a-ae38-4212-8bde-88dd4d299530 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:22.404722 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-70be3a7a-ae38-4212-8bde-88dd4d299530 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:22.404722 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:22.404722 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:22.404722 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:22.404722 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:22.404722 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:22.404722 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:22.404722 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:22.404722 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:22.404722 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:22.404722 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:22.404722 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:22.404722 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:52:22.404722 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:52:22.404722 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:52:22.405628 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:52:22.405628 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:22.405628 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:22.405628 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:22.405628 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:22.405628 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:22.405628 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:22.405628 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:22.405628 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:22.405628 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:22.405628 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:22.405628 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:22.405628 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:22.405628 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:22.405628 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:22.405628 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:22.405628 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:22.406479 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:52:22.406479 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:52:22.406479 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:22.406479 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:22.408692 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 234/459] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:52:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:22.416130 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be3a7a-ae38-4212-8bde-88dd4d299530 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:22.417681 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 226/460] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:52:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:52:22.458184 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a0e2d-aa75-4e29-ad6b-c319e04af86f None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:22.499020 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:22.562813 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be3a7a-ae38-4212-8bde-88dd4d299530 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:22.599623 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:22.633665 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9224a5-24bf-4e04-97da-bb4a741e79c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:22.634342 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9224a5-24bf-4e04-97da-bb4a741e79c4 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:22.634627 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9224a5-24bf-4e04-97da-bb4a741e79c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:22.635057 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9224a5-24bf-4e04-97da-bb4a741e79c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:22.635939 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9224a5-24bf-4e04-97da-bb4a741e79c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:22.636254 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9224a5-24bf-4e04-97da-bb4a741e79c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:22.637702 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9224a5-24bf-4e04-97da-bb4a741e79c4 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:22.652420 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 235/461] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:52:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:22.653723 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b7083-24fc-48b6-a750-067290d144dd None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:22.654015 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b7083-24fc-48b6-a750-067290d144dd None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:22.654289 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b7083-24fc-48b6-a750-067290d144dd None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:22.655554 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a0e2d-aa75-4e29-ad6b-c319e04af86f None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:22.659535 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 236/462] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:52:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:52:22.660342 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5b7083-24fc-48b6-a750-067290d144dd None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:22.702508 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20e627-b26e-46f9-8c31-823ea747a49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:22.704121 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20e627-b26e-46f9-8c31-823ea747a49f None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:22.704645 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20e627-b26e-46f9-8c31-823ea747a49f None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:22.705122 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20e627-b26e-46f9-8c31-823ea747a49f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:22.720796 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f20e627-b26e-46f9-8c31-823ea747a49f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:22.723451 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f20e627-b26e-46f9-8c31-823ea747a49f None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:22.746352 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-4f20e627-b26e-46f9-8c31-823ea747a49f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:22.746352 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:22.746352 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:22.746352 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:22.746352 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:22.746352 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:22.746352 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:22.746352 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:22.746352 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:22.746352 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:22.746352 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:22.746352 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:22.746352 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:52:22.746352 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:52:22.746352 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:52:22.747246 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:52:22.747246 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:22.747246 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:22.747246 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:22.747246 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:22.747246 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:22.747246 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:22.747246 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:22.747246 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:22.747246 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:22.747246 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:22.747246 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:22.747246 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:22.747246 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:22.747246 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:22.747246 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:22.747246 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:22.748208 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:52:22.748208 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:52:22.748208 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:22.748208 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:22.753712 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 227/463] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:52:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:52:22.753712 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c5f98-0c4a-422d-b9d4-aa3a92306bd5 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:22.753712 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c5f98-0c4a-422d-b9d4-aa3a92306bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:22.753712 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c5f98-0c4a-422d-b9d4-aa3a92306bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:22.779491 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-482c5f98-0c4a-422d-b9d4-aa3a92306bd5 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:22.780702 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-482c5f98-0c4a-422d-b9d4-aa3a92306bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:22.785655 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5b7083-24fc-48b6-a750-067290d144dd None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:22.804290 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:22.833105 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5cfbfb-1d64-428c-982d-de622e736cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:22.834274 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5cfbfb-1d64-428c-982d-de622e736cd6 None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:22.835114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5cfbfb-1d64-428c-982d-de622e736cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:22.835722 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5cfbfb-1d64-428c-982d-de622e736cd6 None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:22.836577 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5cfbfb-1d64-428c-982d-de622e736cd6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:22.839270 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5cfbfb-1d64-428c-982d-de622e736cd6 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:22.853078 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 228/464] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:52:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:52:22.860487 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c5f98-0c4a-422d-b9d4-aa3a92306bd5 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:22.874109 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 237/465] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Jul 27 18:52:22 2022] POST /identity/v3/users => generated 246 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:52:22.888970 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5cfbfb-1d64-428c-982d-de622e736cd6 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:22.947735 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:23.011639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c5f98-0c4a-422d-b9d4-aa3a92306bd5 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:23.027278 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5cfbfb-1d64-428c-982d-de622e736cd6 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:23.059380 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8efa9fa-a6e7-4b61-b4f2-36393c1e379a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:23.060121 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efa9fa-a6e7-4b61-b4f2-36393c1e379a None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:23.060315 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efa9fa-a6e7-4b61-b4f2-36393c1e379a None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:23.061240 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8efa9fa-a6e7-4b61-b4f2-36393c1e379a None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:23.061240 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8efa9fa-a6e7-4b61-b4f2-36393c1e379a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:23.061775 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8efa9fa-a6e7-4b61-b4f2-36393c1e379a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:23.063070 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8efa9fa-a6e7-4b61-b4f2-36393c1e379a None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:23.078649 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf9f9b-8ad4-4a3c-9d86-3eebe33075f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:23.079306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf9f9b-8ad4-4a3c-9d86-3eebe33075f2 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:23.079589 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf9f9b-8ad4-4a3c-9d86-3eebe33075f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:23.079784 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 229/466] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:52:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:23.079883 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf9f9b-8ad4-4a3c-9d86-3eebe33075f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:23.081166 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496290b-1ed1-4212-8e9b-4059228be905 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:23.081461 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496290b-1ed1-4212-8e9b-4059228be905 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:23.081743 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496290b-1ed1-4212-8e9b-4059228be905 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:23.083107 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 230/467] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:52:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:52:23.088425 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5496290b-1ed1-4212-8e9b-4059228be905 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:23.092990 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf9f9b-8ad4-4a3c-9d86-3eebe33075f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:23.094519 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf9f9b-8ad4-4a3c-9d86-3eebe33075f2 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:23.112086 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-13cf9f9b-8ad4-4a3c-9d86-3eebe33075f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:23.112086 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:23.112086 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:23.112086 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:23.112086 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:23.112086 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:23.112086 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:23.112086 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:23.112086 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:23.112086 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:23.112086 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:23.112086 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:23.112086 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:52:23.112086 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:52:23.112086 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:52:23.113051 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:52:23.113051 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:23.113051 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:23.113051 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:23.113051 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:23.113051 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:23.113051 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:23.113051 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:23.113051 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:23.113051 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:23.113051 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:23.113051 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:23.113051 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:23.113051 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:23.113051 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:23.113051 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:23.113051 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:23.113954 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:52:23.113954 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:52:23.113954 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:23.113954 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:23.118134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 238/468] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:52:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:52:23.119550 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392775c-65bc-4d38-af24-e83618b6abf6 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:23.119894 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392775c-65bc-4d38-af24-e83618b6abf6 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:23.120160 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392775c-65bc-4d38-af24-e83618b6abf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:23.140226 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-2392775c-65bc-4d38-af24-e83618b6abf6 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:23.141396 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-2392775c-65bc-4d38-af24-e83618b6abf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:23.170292 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:23.228720 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5496290b-1ed1-4212-8e9b-4059228be905 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:23.248439 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:23.255706 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 239/469] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:52:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:52:23.255706 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2392775c-65bc-4d38-af24-e83618b6abf6 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:23.300548 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5da6f-a20a-41c8-b5f0-7100c8cb9786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:23.301094 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5da6f-a20a-41c8-b5f0-7100c8cb9786 None admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:23.301371 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5da6f-a20a-41c8-b5f0-7100c8cb9786 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:23.301645 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5da6f-a20a-41c8-b5f0-7100c8cb9786 None admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:23.302368 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb5da6f-a20a-41c8-b5f0-7100c8cb9786 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:23.304352 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb5da6f-a20a-41c8-b5f0-7100c8cb9786 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:23.329202 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 231/470] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Jul 27 18:52:23 2022] POST /identity/v3/users => generated 248 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:52:23.330209 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5da6f-a20a-41c8-b5f0-7100c8cb9786 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:23.390854 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2392775c-65bc-4d38-af24-e83618b6abf6 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:23.430335 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb772ab-4431-4601-9333-d48f6e8afa99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:23.432056 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb772ab-4431-4601-9333-d48f6e8afa99 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:23.432676 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb772ab-4431-4601-9333-d48f6e8afa99 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:23.433155 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb772ab-4431-4601-9333-d48f6e8afa99 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:23.434151 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb772ab-4431-4601-9333-d48f6e8afa99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:23.434660 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb772ab-4431-4601-9333-d48f6e8afa99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:23.436457 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb772ab-4431-4601-9333-d48f6e8afa99 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:23.454778 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 240/471] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:52:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:23.454964 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5da6f-a20a-41c8-b5f0-7100c8cb9786 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:23.456649 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb772ab-4431-4601-9333-d48f6e8afa99 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:23.470933 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:23.497162 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340480f-9d1e-4f62-802a-17c6e31ef0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:23.497865 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340480f-9d1e-4f62-802a-17c6e31ef0d7 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:23.498148 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340480f-9d1e-4f62-802a-17c6e31ef0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:23.498424 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340480f-9d1e-4f62-802a-17c6e31ef0d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:23.511790 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7340480f-9d1e-4f62-802a-17c6e31ef0d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:23.513419 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7340480f-9d1e-4f62-802a-17c6e31ef0d7 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:23.531791 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-7340480f-9d1e-4f62-802a-17c6e31ef0d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:23.531791 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:23.531791 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:23.531791 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:23.531791 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:23.531791 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:23.531791 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:23.531791 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:23.531791 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:23.531791 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:23.531791 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:23.531791 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:23.531791 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:52:23.531791 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:52:23.531791 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:52:23.532764 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:52:23.532764 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:23.532764 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:23.532764 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:23.532764 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:23.532764 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:23.532764 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:23.532764 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:23.532764 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:23.532764 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:23.532764 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:23.532764 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:23.532764 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:23.532764 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:23.532764 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:23.532764 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:23.532764 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:23.533626 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:52:23.533626 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:52:23.533626 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:23.533626 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:23.533626 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 232/472] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:52:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:23.540163 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340480f-9d1e-4f62-802a-17c6e31ef0d7 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:23.566974 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:23.600143 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb772ab-4431-4601-9333-d48f6e8afa99 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:23.638696 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced05035-f2ac-49f2-9a48-40fdb774d322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:23.639715 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced05035-f2ac-49f2-9a48-40fdb774d322 None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:23.640055 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced05035-f2ac-49f2-9a48-40fdb774d322 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:23.640480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced05035-f2ac-49f2-9a48-40fdb774d322 None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:23.641180 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced05035-f2ac-49f2-9a48-40fdb774d322 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:23.642619 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced05035-f2ac-49f2-9a48-40fdb774d322 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:23.669922 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340480f-9d1e-4f62-802a-17c6e31ef0d7 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:23.675788 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 241/473] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Jul 27 18:52:23 2022] POST /identity/v3/users => generated 248 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:52:23.677342 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039069d-4e3e-42e8-a58b-cd7bd771a52f None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:23.677626 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039069d-4e3e-42e8-a58b-cd7bd771a52f None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:23.677969 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039069d-4e3e-42e8-a58b-cd7bd771a52f None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:23.679723 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 242/474] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:52:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:52:23.685557 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a784ed2-2218-4fb3-a95e-a56d8f1dd2aa None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:23.686246 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a784ed2-2218-4fb3-a95e-a56d8f1dd2aa None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:23.686956 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a784ed2-2218-4fb3-a95e-a56d8f1dd2aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:23.716665 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40eac0f-234a-4d34-bab3-c934f7fdb1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:23.717431 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40eac0f-234a-4d34-bab3-c934f7fdb1ae None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:23.717710 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40eac0f-234a-4d34-bab3-c934f7fdb1ae None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:23.718032 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40eac0f-234a-4d34-bab3-c934f7fdb1ae None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:23.718709 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-0a784ed2-2218-4fb3-a95e-a56d8f1dd2aa None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:23.718819 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40eac0f-234a-4d34-bab3-c934f7fdb1ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:23.719042 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40eac0f-234a-4d34-bab3-c934f7fdb1ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:23.721380 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40eac0f-234a-4d34-bab3-c934f7fdb1ae None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:23.722458 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-0a784ed2-2218-4fb3-a95e-a56d8f1dd2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:23.742932 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 233/475] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:52:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:23.749827 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40eac0f-234a-4d34-bab3-c934f7fdb1ae None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:23.827828 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:23.841728 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 243/476] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:52:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:52:23.873353 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:23.876979 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a784ed2-2218-4fb3-a95e-a56d8f1dd2aa None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:23.903246 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40eac0f-234a-4d34-bab3-c934f7fdb1ae None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:23.941700 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf356ac1-0389-49f5-871d-ca54b0e903c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:23.942393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf356ac1-0389-49f5-871d-ca54b0e903c3 None admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:23.942679 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf356ac1-0389-49f5-871d-ca54b0e903c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:23.942960 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf356ac1-0389-49f5-871d-ca54b0e903c3 None admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:23.943721 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf356ac1-0389-49f5-871d-ca54b0e903c3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:23.945595 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf356ac1-0389-49f5-871d-ca54b0e903c3 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:23.975288 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 234/477] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Jul 27 18:52:23 2022] POST /identity/v3/users => generated 249 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:52:24.016554 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a784ed2-2218-4fb3-a95e-a56d8f1dd2aa None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:24.057427 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c692f-fed3-4bb1-b205-a53303b43054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:24.058066 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c692f-fed3-4bb1-b205-a53303b43054 None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:24.058394 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c692f-fed3-4bb1-b205-a53303b43054 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:24.058675 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c692f-fed3-4bb1-b205-a53303b43054 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:24.059411 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809c692f-fed3-4bb1-b205-a53303b43054 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:24.060836 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809c692f-fed3-4bb1-b205-a53303b43054 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:24.069250 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.sql.core [None req-809c692f-fed3-4bb1-b205-a53303b43054 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 27 18:52:24.069250 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 27 18:52:24.069250 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [parameters: {'id': '1d407b95e7814b269deb2ab86f477e9f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 27 18:52:24.069250 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80076) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 27 18:52:24.086738 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-809c692f-fed3-4bb1-b205-a53303b43054 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 27 18:52:24.086738 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:24.086738 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 18:52:24.086738 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 18:52:24.086738 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 18:52:24.086738 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 18:52:24.086738 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 18:52:24.086738 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 18:52:24.086738 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 18:52:24.086738 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application conn.query(q) Jul 27 18:52:24.086738 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 18:52:24.086738 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 18:52:24.086738 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 18:52:24.086738 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application result.read() Jul 27 18:52:24.086738 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 18:52:24.088226 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 18:52:24.088226 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 18:52:24.088226 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 18:52:24.088226 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 18:52:24.088226 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 18:52:24.088226 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 18:52:24.088226 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 18:52:24.088226 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 27 18:52:24.088226 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:24.088226 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 27 18:52:24.088226 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:24.088226 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:24.088226 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 27 18:52:24.088226 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 27 18:52:24.088226 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 27 18:52:24.088226 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return ref.to_dict() Jul 27 18:52:24.088226 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 18:52:24.088226 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application next(self.gen) Jul 27 18:52:24.089131 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 27 18:52:24.089131 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application yield resource Jul 27 18:52:24.089131 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 18:52:24.089131 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application next(self.gen) Jul 27 18:52:24.089131 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 27 18:52:24.089131 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application self.session.rollback() Jul 27 18:52:24.089131 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 27 18:52:24.089131 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application self.force_reraise() Jul 27 18:52:24.089131 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 27 18:52:24.089131 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise self.value Jul 27 18:52:24.089131 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 27 18:52:24.089131 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 27 18:52:24.089131 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 27 18:52:24.089131 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application session.commit() Jul 27 18:52:24.089131 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 27 18:52:24.089131 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 27 18:52:24.089131 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 27 18:52:24.089976 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._prepare_impl() Jul 27 18:52:24.089976 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 27 18:52:24.089976 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application self.session.flush() Jul 27 18:52:24.089976 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 27 18:52:24.089976 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._flush(objects) Jul 27 18:52:24.089976 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 27 18:52:24.089976 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 27 18:52:24.089976 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 27 18:52:24.089976 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application compat.raise_( Jul 27 18:52:24.089976 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 18:52:24.089976 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception Jul 27 18:52:24.089976 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 27 18:52:24.089976 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application flush_context.execute() Jul 27 18:52:24.089976 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 27 18:52:24.089976 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rec.execute(self) Jul 27 18:52:24.089976 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 27 18:52:24.089976 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 27 18:52:24.090863 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 27 18:52:24.090863 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 27 18:52:24.090863 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 27 18:52:24.090863 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 27 18:52:24.090863 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 27 18:52:24.090863 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 27 18:52:24.090863 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 27 18:52:24.090863 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 27 18:52:24.090863 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 27 18:52:24.090863 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 27 18:52:24.090863 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 27 18:52:24.090863 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 27 18:52:24.090863 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 27 18:52:24.090863 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 27 18:52:24.090863 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 18:52:24.090863 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception Jul 27 18:52:24.091877 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 18:52:24.091877 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 18:52:24.091877 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 18:52:24.091877 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 18:52:24.091877 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 18:52:24.091877 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 18:52:24.091877 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 18:52:24.091877 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application conn.query(q) Jul 27 18:52:24.091877 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 18:52:24.091877 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 18:52:24.091877 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 18:52:24.091877 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application result.read() Jul 27 18:52:24.091877 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 18:52:24.091877 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 18:52:24.091877 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 18:52:24.091877 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 18:52:24.092684 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 18:52:24.092684 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 18:52:24.092684 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 18:52:24.092684 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 18:52:24.092684 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 27 18:52:24.092684 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 27 18:52:24.092684 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [parameters: {'id': '1d407b95e7814b269deb2ab86f477e9f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 27 18:52:24.092684 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 27 18:52:24.092684 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:24.092684 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:52:24.092684 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:24.092684 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:24.092684 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:24.092684 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:24.092684 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:24.092684 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:24.093493 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:24.093493 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:24.093493 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:24.093493 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:24.093493 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:24.093493 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:24.093493 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 27 18:52:24.093493 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 27 18:52:24.093493 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:24.093493 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:24.093493 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 27 18:52:24.093493 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 27 18:52:24.093493 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 27 18:52:24.093493 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 27 18:52:24.093493 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 27 18:52:24.093493 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:24.094339 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 244/478] 10.222.0.20 () {60 vars in 1131 bytes} [Wed Jul 27 18:52:23 2022] POST /identity/v3/roles => generated 144 bytes in 212 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:52:24.099306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf356ac1-0389-49f5-871d-ca54b0e903c3 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:24.210452 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf356ac1-0389-49f5-871d-ca54b0e903c3 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:24.249058 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119082fd-1cd7-4269-a887-11e81431b671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:24.249773 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119082fd-1cd7-4269-a887-11e81431b671 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:24.250054 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119082fd-1cd7-4269-a887-11e81431b671 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:24.250326 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119082fd-1cd7-4269-a887-11e81431b671 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:24.253085 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:24.263638 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119082fd-1cd7-4269-a887-11e81431b671 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:52:24.268608 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-119082fd-1cd7-4269-a887-11e81431b671 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:52:24.268608 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:24.268608 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:24.268608 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:24.268608 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:24.268608 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:24.268608 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:24.268608 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:24.268608 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:24.268608 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:24.268608 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:24.268608 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:24.268608 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:52:24.268608 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:52:24.268608 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:52:24.268608 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:52:24.270593 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:52:24.270593 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:52:24.270593 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:52:24.270593 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:52:24.270593 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:24.270593 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:24.270593 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:24.270593 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:24.270593 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:24.270593 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:24.270593 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:24.270593 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:24.270593 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:24.270593 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:24.270593 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:24.270593 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:24.272541 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:24.272541 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:24.272541 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:24.272541 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:24.272541 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:52:24.272541 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:52:24.272541 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:52:24.272541 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:52:24.272541 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:52:24.272541 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:52:24.272541 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:52:24.272541 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:24.272541 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 235/479] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 27 18:52:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:24.276143 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c692f-fed3-4bb1-b205-a53303b43054 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:24.340799 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:24.387924 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c692f-fed3-4bb1-b205-a53303b43054 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:24.424441 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a40a0e-57fc-49d9-98f1-63af7daf6508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:24.425064 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a40a0e-57fc-49d9-98f1-63af7daf6508 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:24.425344 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a40a0e-57fc-49d9-98f1-63af7daf6508 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:24.425616 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a40a0e-57fc-49d9-98f1-63af7daf6508 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:24.426334 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a40a0e-57fc-49d9-98f1-63af7daf6508 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:24.426641 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a40a0e-57fc-49d9-98f1-63af7daf6508 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:24.428035 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a40a0e-57fc-49d9-98f1-63af7daf6508 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:24.437148 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 245/480] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 27 18:52:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:25.383823 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8315b4-7bf0-4218-a815-268df432eb27 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:25.384882 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8315b4-7bf0-4218-a815-268df432eb27 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:25.384958 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8315b4-7bf0-4218-a815-268df432eb27 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:25.386491 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 236/481] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:52:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:52:25.391947 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb9e73-4d1c-40b5-85a0-6f4e14aa3646 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:25.392344 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb9e73-4d1c-40b5-85a0-6f4e14aa3646 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:25.392545 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb9e73-4d1c-40b5-85a0-6f4e14aa3646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:25.420682 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-5bbb9e73-4d1c-40b5-85a0-6f4e14aa3646 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:25.421875 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-5bbb9e73-4d1c-40b5-85a0-6f4e14aa3646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:25.516529 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 246/482] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:52:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:52:25.552065 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8315b4-7bf0-4218-a815-268df432eb27 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:25.693856 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8315b4-7bf0-4218-a815-268df432eb27 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:25.728039 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917450eb-5ca2-4079-bafd-492b72733fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:25.729138 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917450eb-5ca2-4079-bafd-492b72733fcd None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:25.729419 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917450eb-5ca2-4079-bafd-492b72733fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:25.729692 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917450eb-5ca2-4079-bafd-492b72733fcd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:25.740138 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917450eb-5ca2-4079-bafd-492b72733fcd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:52:25.745996 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-917450eb-5ca2-4079-bafd-492b72733fcd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:52:25.745996 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:25.745996 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:25.745996 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:25.745996 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:25.745996 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:25.745996 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:25.745996 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:25.745996 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:25.745996 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:25.745996 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:25.745996 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:25.745996 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:52:25.745996 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:52:25.745996 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:52:25.745996 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:52:25.746952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:52:25.746952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:52:25.746952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:52:25.746952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:52:25.746952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:25.746952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:25.746952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:25.746952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:25.746952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:25.746952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:25.746952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:25.746952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:25.746952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:25.746952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:25.746952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:25.746952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:25.747768 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:25.747768 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:25.747768 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:25.747768 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:25.747768 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:52:25.747768 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:52:25.747768 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:52:25.747768 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:52:25.747768 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:52:25.747768 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:52:25.747768 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:52:25.747768 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:25.747768 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 237/483] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 27 18:52:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:25.752976 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbb9e73-4d1c-40b5-85a0-6f4e14aa3646 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:25.808426 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:25.856707 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbb9e73-4d1c-40b5-85a0-6f4e14aa3646 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:25.890870 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b02ea1f-6d91-416e-a5e6-14f6ff6acd4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:25.891493 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02ea1f-6d91-416e-a5e6-14f6ff6acd4e None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:25.891792 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02ea1f-6d91-416e-a5e6-14f6ff6acd4e None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:25.892063 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02ea1f-6d91-416e-a5e6-14f6ff6acd4e None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:25.892775 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b02ea1f-6d91-416e-a5e6-14f6ff6acd4e None admin] RBAC: Adding query filter params (name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:25.893073 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b02ea1f-6d91-416e-a5e6-14f6ff6acd4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:25.894422 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b02ea1f-6d91-416e-a5e6-14f6ff6acd4e None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:25.903575 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 247/484] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Jul 27 18:52:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:25.908662 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917450eb-5ca2-4079-bafd-492b72733fcd None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:25.966594 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:26.010717 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917450eb-5ca2-4079-bafd-492b72733fcd None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:26.044746 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facedc58-c506-4cff-9573-1fc48551f8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:26.045381 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facedc58-c506-4cff-9573-1fc48551f8a4 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:26.045653 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facedc58-c506-4cff-9573-1fc48551f8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:26.045921 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facedc58-c506-4cff-9573-1fc48551f8a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:26.057637 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facedc58-c506-4cff-9573-1fc48551f8a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:26.059089 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facedc58-c506-4cff-9573-1fc48551f8a4 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:26.073824 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-facedc58-c506-4cff-9573-1fc48551f8a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:26.073824 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:26.073824 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:26.073824 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:26.073824 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:26.073824 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:26.073824 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:26.073824 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:26.073824 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:26.073824 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:26.073824 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:26.073824 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:26.073824 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:52:26.073824 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:52:26.073824 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:52:26.074672 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:52:26.074672 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:26.074672 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:26.074672 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:26.074672 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:26.074672 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:26.074672 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:26.074672 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:26.074672 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:26.074672 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:26.074672 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:26.074672 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:26.074672 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:26.074672 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:26.074672 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:26.074672 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:26.074672 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:26.075510 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:52:26.075510 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:52:26.075510 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:26.075510 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:26.075510 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 238/485] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:52:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:52:26.080488 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b02ea1f-6d91-416e-a5e6-14f6ff6acd4e None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:26.233245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629818a-1473-4781-a6d2-98b3baa93aa1 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:26.233582 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629818a-1473-4781-a6d2-98b3baa93aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:26.233683 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629818a-1473-4781-a6d2-98b3baa93aa1 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:26.235298 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 239/486] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:52:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:52:26.241450 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a128a07-9aae-418d-8340-e4c0d9d80901 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:26.241728 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a128a07-9aae-418d-8340-e4c0d9d80901 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:26.241998 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a128a07-9aae-418d-8340-e4c0d9d80901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:26.248528 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b02ea1f-6d91-416e-a5e6-14f6ff6acd4e None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:26.262614 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-2a128a07-9aae-418d-8340-e4c0d9d80901 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:26.263848 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-2a128a07-9aae-418d-8340-e4c0d9d80901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:26.283542 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:26.319197 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff441d8-7c53-4ab6-854d-251114706873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:26.319894 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff441d8-7c53-4ab6-854d-251114706873 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:26.320180 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff441d8-7c53-4ab6-854d-251114706873 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:26.320456 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff441d8-7c53-4ab6-854d-251114706873 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:26.321202 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff441d8-7c53-4ab6-854d-251114706873 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:26.321552 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff441d8-7c53-4ab6-854d-251114706873 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:26.322914 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff441d8-7c53-4ab6-854d-251114706873 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:26.340016 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 248/487] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:52:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:26.340590 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 240/488] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:52:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:52:26.341271 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf012f31-12a3-4a12-b866-e2de86e23839 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:26.341461 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a128a07-9aae-418d-8340-e4c0d9d80901 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:26.341553 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf012f31-12a3-4a12-b866-e2de86e23839 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:26.341827 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf012f31-12a3-4a12-b866-e2de86e23839 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:26.343124 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 249/489] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:52:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:52:26.355576 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bfef35-d700-4c2c-bf44-ae7898018b77 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:26.355899 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bfef35-d700-4c2c-bf44-ae7898018b77 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:26.356169 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bfef35-d700-4c2c-bf44-ae7898018b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:26.382453 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-f8bfef35-d700-4c2c-bf44-ae7898018b77 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:26.383716 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-f8bfef35-d700-4c2c-bf44-ae7898018b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:26.404869 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:26.464018 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 250/490] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:52:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:52:26.465664 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bfef35-d700-4c2c-bf44-ae7898018b77 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:26.482414 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a128a07-9aae-418d-8340-e4c0d9d80901 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:26.528838 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb91276-92d8-4d08-aeb6-a198c1f53949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:26.529408 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb91276-92d8-4d08-aeb6-a198c1f53949 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:26.529685 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb91276-92d8-4d08-aeb6-a198c1f53949 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:26.529982 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb91276-92d8-4d08-aeb6-a198c1f53949 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:26.537638 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb91276-92d8-4d08-aeb6-a198c1f53949 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:26.539087 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb91276-92d8-4d08-aeb6-a198c1f53949 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:26.553393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-fdb91276-92d8-4d08-aeb6-a198c1f53949 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 18:52:26.553393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:26.553393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:26.553393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:26.553393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:26.553393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:26.553393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:26.553393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:26.553393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:26.553393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:26.553393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:26.553393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:26.553393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:52:26.553393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:52:26.553393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:52:26.553393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:52:26.554538 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:26.554538 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:26.554538 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:52:26.554538 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:52:26.554538 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:52:26.554538 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:52:26.554538 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:26.554538 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:26.554538 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:26.554538 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:26.554538 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:26.554538 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:26.554538 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:26.554538 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:26.554538 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:26.554538 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:26.554538 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:26.554538 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:26.555544 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:26.555544 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:26.555544 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:52:26.555544 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:52:26.555544 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:52:26.555544 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:52:26.555544 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:52:26.555544 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:52:26.555544 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 18:52:26.555544 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:26.559484 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 241/491] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Jul 27 18:52:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:26.560337 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb91276-92d8-4d08-aeb6-a198c1f53949 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:26.595652 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bfef35-d700-4c2c-bf44-ae7898018b77 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:26.598436 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:26.635454 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f94da2-24e5-449e-9daa-5133ab67c175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:26.636150 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f94da2-24e5-449e-9daa-5133ab67c175 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:26.636435 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f94da2-24e5-449e-9daa-5133ab67c175 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:26.636808 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f94da2-24e5-449e-9daa-5133ab67c175 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:26.648043 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f94da2-24e5-449e-9daa-5133ab67c175 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:52:26.654991 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-12f94da2-24e5-449e-9daa-5133ab67c175 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:52:26.654991 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:26.654991 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:26.654991 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:26.654991 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:26.654991 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:26.654991 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:26.654991 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:26.654991 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:26.654991 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:26.654991 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:26.654991 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:26.654991 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:52:26.654991 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:52:26.654991 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:52:26.654991 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:52:26.656106 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:52:26.656106 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:52:26.656106 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:52:26.656106 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:52:26.656106 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:26.656106 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:26.656106 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:26.656106 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:26.656106 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:26.656106 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:26.656106 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:26.656106 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:26.656106 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:26.656106 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:26.656106 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:26.656106 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:26.657058 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:26.657058 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:26.657058 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:26.657058 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:26.657058 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:52:26.657058 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:52:26.657058 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:52:26.657058 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:52:26.657058 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:52:26.657058 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:52:26.657058 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:52:26.657058 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:26.657058 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 251/492] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 27 18:52:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:26.657714 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f94da2-24e5-449e-9daa-5133ab67c175 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:26.673817 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:26.677768 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb91276-92d8-4d08-aeb6-a198c1f53949 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:26.716897 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c51ceb-4516-49da-b3af-8083a804a379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:26.717879 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c51ceb-4516-49da-b3af-8083a804a379 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:26.718461 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c51ceb-4516-49da-b3af-8083a804a379 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:26.718919 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c51ceb-4516-49da-b3af-8083a804a379 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:26.730672 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c51ceb-4516-49da-b3af-8083a804a379 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:52:26.737196 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-42c51ceb-4516-49da-b3af-8083a804a379 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:52:26.737196 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:26.737196 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:26.737196 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:26.737196 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:26.737196 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:26.737196 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:26.737196 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:26.737196 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:26.737196 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:26.737196 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:26.737196 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:26.737196 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:52:26.737196 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:52:26.737196 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:52:26.737196 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:52:26.738284 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:52:26.738284 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:52:26.738284 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:52:26.738284 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:52:26.738284 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:26.738284 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:26.738284 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:26.738284 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:26.738284 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:26.738284 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:26.738284 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:26.738284 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:26.738284 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:26.738284 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:26.738284 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:26.738284 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:26.739232 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:26.739232 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:26.739232 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:26.739232 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:26.739232 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:52:26.739232 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:52:26.739232 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:52:26.739232 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:52:26.739232 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:52:26.739232 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:52:26.739232 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:52:26.739232 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:26.746101 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 242/493] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 27 18:52:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:26.747235 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c51ceb-4516-49da-b3af-8083a804a379 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:26.771175 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f94da2-24e5-449e-9daa-5133ab67c175 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:26.807706 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec11bff-8da0-4106-a05b-a39e47d4719a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:26.808508 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec11bff-8da0-4106-a05b-a39e47d4719a None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:26.808798 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec11bff-8da0-4106-a05b-a39e47d4719a None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:26.809220 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec11bff-8da0-4106-a05b-a39e47d4719a None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:26.810344 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec11bff-8da0-4106-a05b-a39e47d4719a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:26.810658 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec11bff-8da0-4106-a05b-a39e47d4719a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:26.812137 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec11bff-8da0-4106-a05b-a39e47d4719a None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:26.850167 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 252/494] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Jul 27 18:52:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:26.851000 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec11bff-8da0-4106-a05b-a39e47d4719a None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:26.857089 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c51ceb-4516-49da-b3af-8083a804a379 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:26.876883 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:26.893651 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9eead0-778e-4722-b6f3-a2a8b95220a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:26.894679 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9eead0-778e-4722-b6f3-a2a8b95220a3 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:26.894965 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9eead0-778e-4722-b6f3-a2a8b95220a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:26.895241 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9eead0-778e-4722-b6f3-a2a8b95220a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:26.896343 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9eead0-778e-4722-b6f3-a2a8b95220a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:26.896671 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9eead0-778e-4722-b6f3-a2a8b95220a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:26.898650 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9eead0-778e-4722-b6f3-a2a8b95220a3 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:26.913218 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 243/495] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Jul 27 18:52:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:26.913218 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8e238-e4b8-491b-a003-1eea11c94b05 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:26.913218 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8e238-e4b8-491b-a003-1eea11c94b05 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:26.913218 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8e238-e4b8-491b-a003-1eea11c94b05 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:26.913556 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 244/496] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:52:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:52:26.914191 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8e238-e4b8-491b-a003-1eea11c94b05 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:26.940399 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:26.959233 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec11bff-8da0-4106-a05b-a39e47d4719a None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:26.995963 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e5ccd-5d42-49c6-8e8a-ec64f5683d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:26.996832 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e5ccd-5d42-49c6-8e8a-ec64f5683d0d None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:26.997110 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e5ccd-5d42-49c6-8e8a-ec64f5683d0d None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:26.997380 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e5ccd-5d42-49c6-8e8a-ec64f5683d0d None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:26.998091 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274e5ccd-5d42-49c6-8e8a-ec64f5683d0d None admin] RBAC: Adding query filter params (name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:26.998394 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274e5ccd-5d42-49c6-8e8a-ec64f5683d0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:26.999789 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274e5ccd-5d42-49c6-8e8a-ec64f5683d0d None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:27.012245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 253/497] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Jul 27 18:52:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:27.012245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e5ccd-5d42-49c6-8e8a-ec64f5683d0d None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:27.035389 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8e238-e4b8-491b-a003-1eea11c94b05 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:27.071962 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b90197-2863-4f14-9a46-273d30b6232d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:27.072694 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b90197-2863-4f14-9a46-273d30b6232d None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:27.072824 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b90197-2863-4f14-9a46-273d30b6232d None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:27.073034 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b90197-2863-4f14-9a46-273d30b6232d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:27.091948 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:27.108689 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e5ccd-5d42-49c6-8e8a-ec64f5683d0d None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:27.140259 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b90197-2863-4f14-9a46-273d30b6232d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:27.141113 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8601cdcb-9d6e-4ec6-a709-8b0e53f2f40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:27.141707 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b90197-2863-4f14-9a46-273d30b6232d None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:27.141906 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601cdcb-9d6e-4ec6-a709-8b0e53f2f40f None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:27.142256 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601cdcb-9d6e-4ec6-a709-8b0e53f2f40f None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:27.142601 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601cdcb-9d6e-4ec6-a709-8b0e53f2f40f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:27.153747 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8601cdcb-9d6e-4ec6-a709-8b0e53f2f40f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:27.155184 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8601cdcb-9d6e-4ec6-a709-8b0e53f2f40f None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:27.161522 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:27.169735 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-8601cdcb-9d6e-4ec6-a709-8b0e53f2f40f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:27.169735 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:27.169735 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:27.169735 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:27.169735 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:27.169735 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:27.169735 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:27.169735 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:27.169735 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:27.169735 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:27.169735 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:27.169735 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:27.169735 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:52:27.169735 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:52:27.169735 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:52:27.170588 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:52:27.170588 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:27.170588 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:27.170588 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:27.170588 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:27.170588 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:27.170588 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:27.170588 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:27.170588 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:27.170588 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:27.170588 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:27.170588 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:27.170588 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:27.170588 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:27.170588 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:27.170588 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:27.170588 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:27.171436 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:52:27.171436 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:52:27.171436 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:27.171436 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:27.171436 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 254/498] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:52:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:27.172090 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0d3ff-d98d-451c-90b7-cfad64bd376d None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:27.172288 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0d3ff-d98d-451c-90b7-cfad64bd376d None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:27.172562 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0d3ff-d98d-451c-90b7-cfad64bd376d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:27.189651 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-07c0d3ff-d98d-451c-90b7-cfad64bd376d None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:27.190856 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-07c0d3ff-d98d-451c-90b7-cfad64bd376d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:27.245333 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 245/499] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 27 18:52:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:52:27.246326 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b90197-2863-4f14-9a46-273d30b6232d None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:27.259954 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 255/500] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:52:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:52:27.261223 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac966c-99b1-4d65-957e-5effba41aa39 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:27.261511 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac966c-99b1-4d65-957e-5effba41aa39 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:27.261788 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac966c-99b1-4d65-957e-5effba41aa39 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:27.263125 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 256/501] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:52:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:52:27.263851 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ac966c-99b1-4d65-957e-5effba41aa39 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:27.332457 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:27.355277 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b90197-2863-4f14-9a46-273d30b6232d None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:27.366204 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ac966c-99b1-4d65-957e-5effba41aa39 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:27.375282 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:27.389906 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c8128-cd3a-4c2f-86c0-552c614fac4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:27.390539 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c8128-cd3a-4c2f-86c0-552c614fac4e None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:27.390819 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c8128-cd3a-4c2f-86c0-552c614fac4e None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:27.391097 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c8128-cd3a-4c2f-86c0-552c614fac4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:27.399938 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044b570-71db-4fd6-9b22-545420dccce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:27.400551 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044b570-71db-4fd6-9b22-545420dccce0 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:27.400839 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044b570-71db-4fd6-9b22-545420dccce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:27.400961 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3c8128-cd3a-4c2f-86c0-552c614fac4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:27.401112 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044b570-71db-4fd6-9b22-545420dccce0 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:27.401801 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5044b570-71db-4fd6-9b22-545420dccce0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:27.402134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5044b570-71db-4fd6-9b22-545420dccce0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:27.402333 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3c8128-cd3a-4c2f-86c0-552c614fac4e None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:27.403494 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5044b570-71db-4fd6-9b22-545420dccce0 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:27.414436 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 257/502] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:52:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:27.415191 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044b570-71db-4fd6-9b22-545420dccce0 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:27.416626 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-2d3c8128-cd3a-4c2f-86c0-552c614fac4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:27.416626 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:27.416626 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:27.416626 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:27.416626 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:27.416626 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:27.416626 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:27.416626 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:27.416626 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:27.416626 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:27.416626 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:27.416626 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:27.416626 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:52:27.416626 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:52:27.416626 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:52:27.417764 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:52:27.417764 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:27.417764 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:27.417764 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:27.417764 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:27.417764 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:27.417764 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:27.417764 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:27.417764 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:27.417764 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:27.417764 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:27.417764 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:27.417764 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:27.417764 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:27.417764 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:27.417764 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:27.417764 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:27.419185 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:52:27.419185 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:52:27.419185 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:27.419185 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:27.419185 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 246/503] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:52:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:27.419185 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21a3a4-fec0-4667-9858-8bbbdce41320 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:27.419185 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21a3a4-fec0-4667-9858-8bbbdce41320 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:27.419641 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21a3a4-fec0-4667-9858-8bbbdce41320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:27.437359 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-4c21a3a4-fec0-4667-9858-8bbbdce41320 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:27.438589 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-4c21a3a4-fec0-4667-9858-8bbbdce41320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:27.504734 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 247/504] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:52:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:52:27.505366 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c21a3a4-fec0-4667-9858-8bbbdce41320 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:27.533405 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044b570-71db-4fd6-9b22-545420dccce0 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:27.558610 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:27.567086 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b9dac1-7a81-4987-84a0-46521206670c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:27.567731 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9dac1-7a81-4987-84a0-46521206670c None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:27.568006 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9dac1-7a81-4987-84a0-46521206670c None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:27.568280 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b9dac1-7a81-4987-84a0-46521206670c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:27.578907 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b9dac1-7a81-4987-84a0-46521206670c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:27.580373 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b9dac1-7a81-4987-84a0-46521206670c None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:27.594190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-d3b9dac1-7a81-4987-84a0-46521206670c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:27.594190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:27.594190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:27.594190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:27.594190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:27.594190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:27.594190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:27.594190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:27.594190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:27.594190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:27.594190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:27.594190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:27.594190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:52:27.594190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:52:27.594190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:52:27.595185 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:52:27.595185 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:27.595185 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:27.595185 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:27.595185 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:27.595185 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:27.595185 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:27.595185 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:27.595185 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:27.595185 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:27.595185 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:27.595185 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:27.595185 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:27.595185 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:27.595185 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:27.595185 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:27.595185 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:27.596263 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:52:27.596263 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:52:27.596263 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:27.596263 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:27.596263 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 258/505] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:52:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:27.596263 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b9dac1-7a81-4987-84a0-46521206670c None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:27.607107 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c21a3a4-fec0-4667-9858-8bbbdce41320 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:27.609007 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:27.643806 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba43e63-9f90-45fd-b629-0d829d445ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:27.644436 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba43e63-9f90-45fd-b629-0d829d445ae8 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:27.644716 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba43e63-9f90-45fd-b629-0d829d445ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:27.644989 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba43e63-9f90-45fd-b629-0d829d445ae8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:27.654714 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba43e63-9f90-45fd-b629-0d829d445ae8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:52:27.659565 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-5ba43e63-9f90-45fd-b629-0d829d445ae8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:52:27.659565 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:27.659565 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:27.659565 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:27.659565 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:27.659565 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:27.659565 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:27.659565 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:27.659565 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:27.659565 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:27.659565 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:27.659565 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:27.659565 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:52:27.659565 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:52:27.659565 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:52:27.659565 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:52:27.660624 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:52:27.660624 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:52:27.660624 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:52:27.660624 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:52:27.660624 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:27.660624 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:27.660624 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:27.660624 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:27.660624 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:27.660624 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:27.660624 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:27.660624 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:27.660624 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:27.660624 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:27.660624 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:27.660624 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:27.661611 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:27.661611 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:27.661611 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:27.661611 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:27.661611 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:52:27.661611 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:52:27.661611 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:52:27.661611 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:52:27.661611 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:52:27.661611 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:52:27.661611 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:52:27.661611 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:27.666072 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 248/506] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 27 18:52:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:27.666878 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba43e63-9f90-45fd-b629-0d829d445ae8 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:27.697427 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b9dac1-7a81-4987-84a0-46521206670c None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:27.730231 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31d7921-4e92-4004-97be-3154445e00ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:27.730862 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d7921-4e92-4004-97be-3154445e00ad None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:27.731149 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d7921-4e92-4004-97be-3154445e00ad None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:27.731426 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d7921-4e92-4004-97be-3154445e00ad None admin] PATH_INFO: `/v3/users/glance` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:27.738964 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31d7921-4e92-4004-97be-3154445e00ad None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:27.740426 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31d7921-4e92-4004-97be-3154445e00ad None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:27.753225 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-a31d7921-4e92-4004-97be-3154445e00ad None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 27 18:52:27.753225 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:27.753225 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:27.753225 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:27.753225 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:27.753225 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:27.753225 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:27.753225 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:27.753225 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:27.753225 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:27.753225 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:27.753225 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:27.753225 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:52:27.753225 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:52:27.753225 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:52:27.753225 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:52:27.754098 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:27.754098 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:27.754098 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:52:27.754098 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:52:27.754098 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:52:27.754098 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:52:27.754098 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:27.754098 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:27.754098 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:27.754098 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:27.754098 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:27.754098 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:27.754098 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:27.754098 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:27.754098 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:27.754098 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:27.754098 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:27.754098 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:27.755121 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:27.755121 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:27.755121 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:52:27.755121 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:52:27.755121 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:52:27.755121 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:52:27.755121 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:52:27.755121 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:52:27.755121 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 27 18:52:27.755121 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:27.755121 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 259/507] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 27 18:52:27 2022] GET /identity/v3/users/glance => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:27.755861 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31d7921-4e92-4004-97be-3154445e00ad None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:27.765702 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba43e63-9f90-45fd-b629-0d829d445ae8 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:27.796734 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:27.799418 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44292538-be90-4459-9688-cc1b5da78e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:27.800056 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44292538-be90-4459-9688-cc1b5da78e5d None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:27.800336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44292538-be90-4459-9688-cc1b5da78e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:27.800619 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44292538-be90-4459-9688-cc1b5da78e5d None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:27.801304 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44292538-be90-4459-9688-cc1b5da78e5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:27.801609 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44292538-be90-4459-9688-cc1b5da78e5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:27.802988 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44292538-be90-4459-9688-cc1b5da78e5d None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:27.814674 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 249/508] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:52:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:27.815444 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44292538-be90-4459-9688-cc1b5da78e5d None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:27.838920 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:27.861051 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31d7921-4e92-4004-97be-3154445e00ad None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:27.893755 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a4f19-2913-44c4-b9c2-3d66d0c3d2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:27.894389 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a4f19-2913-44c4-b9c2-3d66d0c3d2e8 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:27.894666 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a4f19-2913-44c4-b9c2-3d66d0c3d2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:27.894938 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a4f19-2913-44c4-b9c2-3d66d0c3d2e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:27.906308 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20a4f19-2913-44c4-b9c2-3d66d0c3d2e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:27.907780 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20a4f19-2913-44c4-b9c2-3d66d0c3d2e8 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:27.918276 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44292538-be90-4459-9688-cc1b5da78e5d None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:27.922540 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-c20a4f19-2913-44c4-b9c2-3d66d0c3d2e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:27.922540 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:27.922540 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:27.922540 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:27.922540 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:27.922540 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:27.922540 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:27.922540 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:27.922540 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:27.922540 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:27.922540 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:27.922540 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:27.922540 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:52:27.922540 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:52:27.922540 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:52:27.923407 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:52:27.923407 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:27.923407 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:27.923407 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:27.923407 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:27.923407 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:27.923407 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:27.923407 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:27.923407 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:27.923407 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:27.923407 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:27.923407 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:27.923407 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:27.923407 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:27.923407 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:27.923407 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:27.923407 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:27.924271 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:52:27.924271 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:52:27.924271 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:27.924271 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:27.927828 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 260/509] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:52:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:27.929212 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a4f19-2913-44c4-b9c2-3d66d0c3d2e8 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:27.951168 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151de950-70c6-4cce-9710-63f2d221875f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:27.951808 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151de950-70c6-4cce-9710-63f2d221875f None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:27.952095 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151de950-70c6-4cce-9710-63f2d221875f None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:27.952370 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151de950-70c6-4cce-9710-63f2d221875f None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:27.953064 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151de950-70c6-4cce-9710-63f2d221875f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:27.953363 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151de950-70c6-4cce-9710-63f2d221875f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:27.954715 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151de950-70c6-4cce-9710-63f2d221875f None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:27.966837 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 250/510] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:52:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:27.967599 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151de950-70c6-4cce-9710-63f2d221875f None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:28.020361 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:28.030636 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a4f19-2913-44c4-b9c2-3d66d0c3d2e8 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:28.046987 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:28.063276 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71873d7b-430c-464d-aa4c-135ec08bcb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:28.063922 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71873d7b-430c-464d-aa4c-135ec08bcb76 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:28.064204 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71873d7b-430c-464d-aa4c-135ec08bcb76 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:28.064479 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71873d7b-430c-464d-aa4c-135ec08bcb76 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:28.065187 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71873d7b-430c-464d-aa4c-135ec08bcb76 None admin] RBAC: Adding query filter params (name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:28.065320 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151de950-70c6-4cce-9710-63f2d221875f None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:28.065491 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71873d7b-430c-464d-aa4c-135ec08bcb76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:28.066855 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71873d7b-430c-464d-aa4c-135ec08bcb76 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:28.074637 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 261/511] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Jul 27 18:52:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:28.075408 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71873d7b-430c-464d-aa4c-135ec08bcb76 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:28.098817 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6777f18-a913-453c-84a9-d93c77aa5f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:28.099425 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6777f18-a913-453c-84a9-d93c77aa5f78 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:28.099726 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6777f18-a913-453c-84a9-d93c77aa5f78 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:28.100011 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6777f18-a913-453c-84a9-d93c77aa5f78 None admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:28.100801 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6777f18-a913-453c-84a9-d93c77aa5f78 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:28.101108 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6777f18-a913-453c-84a9-d93c77aa5f78 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:28.102527 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6777f18-a913-453c-84a9-d93c77aa5f78 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:28.138202 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 251/512] 10.222.0.20 () {56 vars in 1137 bytes} [Wed Jul 27 18:52:27 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:28.138751 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6777f18-a913-453c-84a9-d93c77aa5f78 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:28.177181 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71873d7b-430c-464d-aa4c-135ec08bcb76 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:28.209676 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc1503-d4b6-42e7-8083-a3dc8a907557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:28.210310 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc1503-d4b6-42e7-8083-a3dc8a907557 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:28.210589 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc1503-d4b6-42e7-8083-a3dc8a907557 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:28.210860 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc1503-d4b6-42e7-8083-a3dc8a907557 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:28.219803 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddc1503-d4b6-42e7-8083-a3dc8a907557 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:28.221426 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddc1503-d4b6-42e7-8083-a3dc8a907557 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:28.232584 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-0ddc1503-d4b6-42e7-8083-a3dc8a907557 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 18:52:28.232584 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:28.232584 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:28.232584 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:28.232584 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:28.232584 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:28.232584 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:28.232584 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:28.232584 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:28.232584 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:28.232584 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:28.232584 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:28.232584 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:52:28.232584 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:52:28.232584 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:52:28.232584 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:52:28.233449 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:28.233449 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:28.233449 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:52:28.233449 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:52:28.233449 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:52:28.233449 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:52:28.233449 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:28.233449 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:28.233449 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:28.233449 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:28.233449 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:28.233449 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:28.233449 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:28.233449 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:28.233449 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:28.233449 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:28.233449 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:28.233449 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:28.234507 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:28.234507 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:28.234507 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:52:28.234507 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:52:28.234507 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:52:28.234507 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:52:28.234507 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:52:28.234507 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:52:28.234507 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 18:52:28.234507 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:28.234507 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 262/513] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 27 18:52:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:28.234507 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc1503-d4b6-42e7-8083-a3dc8a907557 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:28.240430 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6777f18-a913-453c-84a9-d93c77aa5f78 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:28.248695 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:28.276664 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755e633-c3d1-450a-a5e0-946a973a6f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:28.277285 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755e633-c3d1-450a-a5e0-946a973a6f64 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:28.277569 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755e633-c3d1-450a-a5e0-946a973a6f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:28.277847 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755e633-c3d1-450a-a5e0-946a973a6f64 None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:28.278543 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b755e633-c3d1-450a-a5e0-946a973a6f64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:28.278852 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b755e633-c3d1-450a-a5e0-946a973a6f64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:28.280277 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b755e633-c3d1-450a-a5e0-946a973a6f64 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:28.288250 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:28.296044 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 252/514] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:52:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:28.297039 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755e633-c3d1-450a-a5e0-946a973a6f64 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:28.335794 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc1503-d4b6-42e7-8083-a3dc8a907557 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:28.371075 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec8e0d0-7db8-41f0-b7e7-304e98e438ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:28.371729 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8e0d0-7db8-41f0-b7e7-304e98e438ff None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:28.372012 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8e0d0-7db8-41f0-b7e7-304e98e438ff None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:28.372280 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8e0d0-7db8-41f0-b7e7-304e98e438ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:28.378725 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec8e0d0-7db8-41f0-b7e7-304e98e438ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:28.380165 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec8e0d0-7db8-41f0-b7e7-304e98e438ff None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:28.392208 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-6ec8e0d0-7db8-41f0-b7e7-304e98e438ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:52:28.392208 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:28.392208 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:28.392208 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:28.392208 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:28.392208 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:28.392208 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:28.392208 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:28.392208 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:28.392208 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:28.392208 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:28.392208 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:28.392208 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:52:28.392208 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:52:28.392208 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:52:28.393047 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:52:28.393047 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:28.393047 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:28.393047 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:28.393047 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:28.393047 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:28.393047 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:28.393047 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:28.393047 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:28.393047 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:28.393047 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:28.393047 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:28.393047 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:28.393047 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:28.393047 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:28.393047 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:28.393047 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:28.394638 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:52:28.394638 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:52:28.394638 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:52:28.394638 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:52:28.394638 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:52:28.394638 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:52:28.394638 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:52:28.394638 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:28.394638 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 263/515] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 27 18:52:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:28.394638 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec8e0d0-7db8-41f0-b7e7-304e98e438ff None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:28.396529 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755e633-c3d1-450a-a5e0-946a973a6f64 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:28.429806 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a53f01-0d9d-429a-ab0d-2a782335e7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:28.430438 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a53f01-0d9d-429a-ab0d-2a782335e7f2 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:28.430735 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a53f01-0d9d-429a-ab0d-2a782335e7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:28.431011 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a53f01-0d9d-429a-ab0d-2a782335e7f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:28.441543 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a53f01-0d9d-429a-ab0d-2a782335e7f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:28.442994 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a53f01-0d9d-429a-ab0d-2a782335e7f2 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:28.457336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-84a53f01-0d9d-429a-ab0d-2a782335e7f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:28.457336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:28.457336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:28.457336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:28.457336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:28.457336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:28.457336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:28.457336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:28.457336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:28.457336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:28.457336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:28.457336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:28.457336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:52:28.457336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:52:28.457336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:52:28.458336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:52:28.458336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:28.458336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:28.458336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:28.458336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:28.458336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:28.458336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:28.458336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:28.458336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:28.458336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:28.458336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:28.458336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:28.458336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:28.458336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:28.458336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:28.458336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:28.458336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:28.459217 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:52:28.459217 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:52:28.459217 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:28.459217 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:28.459217 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 253/516] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:52:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:28.459513 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a53f01-0d9d-429a-ab0d-2a782335e7f2 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:28.468477 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:28.506051 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec8e0d0-7db8-41f0-b7e7-304e98e438ff None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:28.513092 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:28.543899 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564c61c1-68e7-429d-983e-4408404e4b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:28.544518 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c61c1-68e7-429d-983e-4408404e4b36 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:28.544808 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c61c1-68e7-429d-983e-4408404e4b36 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:28.545083 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c61c1-68e7-429d-983e-4408404e4b36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:28.563632 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a53f01-0d9d-429a-ab0d-2a782335e7f2 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:28.596757 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d930d1a-ae65-4937-9f5f-f98e62a9dced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:28.597357 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d930d1a-ae65-4937-9f5f-f98e62a9dced None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:28.597637 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d930d1a-ae65-4937-9f5f-f98e62a9dced None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:28.597910 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d930d1a-ae65-4937-9f5f-f98e62a9dced None admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:28.598693 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d930d1a-ae65-4937-9f5f-f98e62a9dced None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:28.598997 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d930d1a-ae65-4937-9f5f-f98e62a9dced None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:28.600440 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d930d1a-ae65-4937-9f5f-f98e62a9dced None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:28.612262 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564c61c1-68e7-429d-983e-4408404e4b36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:28.613686 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564c61c1-68e7-429d-983e-4408404e4b36 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:28.617379 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 254/517] 10.222.0.20 () {56 vars in 1137 bytes} [Wed Jul 27 18:52:28 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:28.618146 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d930d1a-ae65-4937-9f5f-f98e62a9dced None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:28.681770 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:28.712455 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 264/518] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 27 18:52:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:52:28.713278 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564c61c1-68e7-429d-983e-4408404e4b36 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:28.716242 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d930d1a-ae65-4937-9f5f-f98e62a9dced None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:28.727413 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:28.751568 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acac6da-0924-439a-9816-ede92f6baa90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:28.752206 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acac6da-0924-439a-9816-ede92f6baa90 None admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:28.752485 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acac6da-0924-439a-9816-ede92f6baa90 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:28.752756 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acac6da-0924-439a-9816-ede92f6baa90 None admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:28.753424 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acac6da-0924-439a-9816-ede92f6baa90 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:28.754841 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acac6da-0924-439a-9816-ede92f6baa90 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:28.775363 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 255/519] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Jul 27 18:52:28 2022] POST /identity/v3/users => generated 247 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:52:28.776022 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acac6da-0924-439a-9816-ede92f6baa90 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:28.829823 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564c61c1-68e7-429d-983e-4408404e4b36 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:28.866444 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb158c3-9927-4dae-a69b-2f75a60ffbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:28.867075 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb158c3-9927-4dae-a69b-2f75a60ffbcf None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:28.867485 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb158c3-9927-4dae-a69b-2f75a60ffbcf None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:28.867787 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb158c3-9927-4dae-a69b-2f75a60ffbcf None admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:28.869061 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb158c3-9927-4dae-a69b-2f75a60ffbcf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:28.869371 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb158c3-9927-4dae-a69b-2f75a60ffbcf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:28.870857 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb158c3-9927-4dae-a69b-2f75a60ffbcf None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:28.890942 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 265/520] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 27 18:52:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:28.890942 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb158c3-9927-4dae-a69b-2f75a60ffbcf None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:28.903437 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acac6da-0924-439a-9816-ede92f6baa90 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:28.926140 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:28.942883 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd4467-f686-439a-a35a-d71a7bd0fa37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:28.943425 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd4467-f686-439a-a35a-d71a7bd0fa37 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:28.943731 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd4467-f686-439a-a35a-d71a7bd0fa37 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:28.944008 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd4467-f686-439a-a35a-d71a7bd0fa37 None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:28.944713 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd4467-f686-439a-a35a-d71a7bd0fa37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:28.945021 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd4467-f686-439a-a35a-d71a7bd0fa37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:28.946946 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd4467-f686-439a-a35a-d71a7bd0fa37 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:28.959881 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 256/521] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:52:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:28.960769 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd4467-f686-439a-a35a-d71a7bd0fa37 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:28.994312 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:29.015446 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb158c3-9927-4dae-a69b-2f75a60ffbcf None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:29.052821 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5514507-1d95-425b-939c-a72bb3bf7e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:29.053442 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5514507-1d95-425b-939c-a72bb3bf7e16 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:29.053726 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5514507-1d95-425b-939c-a72bb3bf7e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:29.053998 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5514507-1d95-425b-939c-a72bb3bf7e16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:29.071662 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd4467-f686-439a-a35a-d71a7bd0fa37 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:29.106420 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062f564-f793-413b-9eb1-b66d5e90be7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:29.107059 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062f564-f793-413b-9eb1-b66d5e90be7d None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:29.107343 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062f564-f793-413b-9eb1-b66d5e90be7d None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:29.107619 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062f564-f793-413b-9eb1-b66d5e90be7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:29.117751 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5062f564-f793-413b-9eb1-b66d5e90be7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:29.119263 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5062f564-f793-413b-9eb1-b66d5e90be7d None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:29.127915 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5514507-1d95-425b-939c-a72bb3bf7e16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:29.129480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5514507-1d95-425b-939c-a72bb3bf7e16 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:29.135031 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-5062f564-f793-413b-9eb1-b66d5e90be7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:29.135031 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:29.135031 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:29.135031 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:29.135031 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:29.135031 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:29.135031 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:29.135031 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:29.135031 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:29.135031 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:29.135031 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:29.135031 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:29.135031 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:52:29.135031 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:52:29.135031 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:52:29.136172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:52:29.136172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:29.136172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:29.136172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:29.136172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:29.136172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:29.136172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:29.136172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:29.136172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:29.136172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:29.136172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:29.136172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:29.136172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:29.136172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:29.136172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:29.136172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:29.136172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:29.136988 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:52:29.136988 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:52:29.136988 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:29.136988 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:29.136988 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 257/522] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:52:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:29.136988 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062f564-f793-413b-9eb1-b66d5e90be7d None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:29.166723 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:29.231422 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:29.249090 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 266/523] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 27 18:52:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:52:29.249836 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5514507-1d95-425b-939c-a72bb3bf7e16 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:29.260683 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062f564-f793-413b-9eb1-b66d5e90be7d None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:29.295452 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e871bbfa-51b8-4f54-b902-3c9b55968128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:29.296105 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871bbfa-51b8-4f54-b902-3c9b55968128 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:29.296356 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871bbfa-51b8-4f54-b902-3c9b55968128 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:29.296629 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871bbfa-51b8-4f54-b902-3c9b55968128 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:29.297424 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e871bbfa-51b8-4f54-b902-3c9b55968128 None admin] RBAC: Adding query filter params (role.id=306da3282d854292a7a53b8642ee373b, scope.project.id=31f027c53398443eb548eaf3f24523e0, user.id=17fbef9db7734283aaad4962ee160171) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:29.297732 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e871bbfa-51b8-4f54-b902-3c9b55968128 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:29.299165 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e871bbfa-51b8-4f54-b902-3c9b55968128 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:29.315726 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 258/524] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 27 18:52:29 2022] GET /identity/v3/role_assignments?user.id=17fbef9db7734283aaad4962ee160171&scope.project.id=31f027c53398443eb548eaf3f24523e0&role.id=306da3282d854292a7a53b8642ee373b => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:29.315726 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e871bbfa-51b8-4f54-b902-3c9b55968128 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:29.367364 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5514507-1d95-425b-939c-a72bb3bf7e16 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:29.408711 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:29.416586 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb017d-6986-4d14-aa73-00228ec708a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:29.417358 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb017d-6986-4d14-aa73-00228ec708a1 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:29.417706 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb017d-6986-4d14-aa73-00228ec708a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:29.418049 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb017d-6986-4d14-aa73-00228ec708a1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:29.426838 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eb017d-6986-4d14-aa73-00228ec708a1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:29.428623 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eb017d-6986-4d14-aa73-00228ec708a1 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:29.442609 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-d5eb017d-6986-4d14-aa73-00228ec708a1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 18:52:29.442609 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:29.442609 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:29.442609 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:29.442609 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:29.442609 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:29.442609 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:29.442609 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:29.442609 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:29.442609 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:29.442609 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:29.442609 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:29.442609 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:52:29.442609 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:52:29.442609 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:52:29.442609 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:52:29.443704 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:29.443704 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:29.443704 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:52:29.443704 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:52:29.443704 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:52:29.443704 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:52:29.443704 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:29.443704 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:29.443704 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:29.443704 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:29.443704 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:29.443704 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:29.443704 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:29.443704 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:29.443704 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:29.443704 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:29.443704 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:29.443704 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:29.444736 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:29.444736 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:29.444736 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:52:29.444736 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:52:29.444736 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:52:29.444736 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:52:29.444736 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:52:29.444736 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:52:29.444736 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 18:52:29.444736 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:29.445271 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 267/525] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 27 18:52:29 2022] GET /identity/v3/users/neutron => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:29.446220 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb017d-6986-4d14-aa73-00228ec708a1 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:29.462492 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e871bbfa-51b8-4f54-b902-3c9b55968128 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:29.507383 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1503eda-1e3f-45d3-b659-fc8ab5df0843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:29.508047 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1503eda-1e3f-45d3-b659-fc8ab5df0843 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:29.508399 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1503eda-1e3f-45d3-b659-fc8ab5df0843 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:29.508805 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1503eda-1e3f-45d3-b659-fc8ab5df0843 None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:29.509671 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1503eda-1e3f-45d3-b659-fc8ab5df0843 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:29.510340 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1503eda-1e3f-45d3-b659-fc8ab5df0843 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:29.511852 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1503eda-1e3f-45d3-b659-fc8ab5df0843 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:29.535367 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 259/526] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:52:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:29.536101 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1503eda-1e3f-45d3-b659-fc8ab5df0843 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:29.538785 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:29.578690 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb017d-6986-4d14-aa73-00228ec708a1 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:29.623457 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281cd6bb-e15f-4342-b63e-3ddee93ca6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:29.624475 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281cd6bb-e15f-4342-b63e-3ddee93ca6f0 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:29.624971 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281cd6bb-e15f-4342-b63e-3ddee93ca6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:29.625450 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281cd6bb-e15f-4342-b63e-3ddee93ca6f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:29.637003 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281cd6bb-e15f-4342-b63e-3ddee93ca6f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:29.638748 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281cd6bb-e15f-4342-b63e-3ddee93ca6f0 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:29.647572 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1503eda-1e3f-45d3-b659-fc8ab5df0843 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:29.654518 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-281cd6bb-e15f-4342-b63e-3ddee93ca6f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:29.654518 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:29.654518 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:29.654518 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:29.654518 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:29.654518 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:29.654518 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:29.654518 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:29.654518 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:29.654518 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:29.654518 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:29.654518 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:29.654518 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:52:29.654518 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:52:29.654518 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:52:29.655533 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:52:29.655533 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:29.655533 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:29.655533 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:29.655533 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:29.655533 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:29.655533 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:29.655533 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:29.655533 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:29.655533 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:29.655533 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:29.655533 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:29.655533 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:29.655533 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:29.655533 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:29.655533 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:29.655533 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:29.656496 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:52:29.656496 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:52:29.656496 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:29.656496 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:29.657913 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 268/527] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:52:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:29.658795 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281cd6bb-e15f-4342-b63e-3ddee93ca6f0 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:29.689787 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347adce-b0df-4e96-b69f-4fd8ec5ddbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:29.690404 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347adce-b0df-4e96-b69f-4fd8ec5ddbfe None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:29.690734 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347adce-b0df-4e96-b69f-4fd8ec5ddbfe None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:29.691030 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347adce-b0df-4e96-b69f-4fd8ec5ddbfe None admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:29.691855 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d347adce-b0df-4e96-b69f-4fd8ec5ddbfe None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:29.692165 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d347adce-b0df-4e96-b69f-4fd8ec5ddbfe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:29.693667 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d347adce-b0df-4e96-b69f-4fd8ec5ddbfe None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:29.717213 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 260/528] 10.222.0.20 () {56 vars in 1139 bytes} [Wed Jul 27 18:52:29 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:29.717213 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347adce-b0df-4e96-b69f-4fd8ec5ddbfe None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:29.718012 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:29.776879 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:29.777396 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281cd6bb-e15f-4342-b63e-3ddee93ca6f0 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:29.813564 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe799f-f52d-49bd-93a1-2bab124f961d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:29.814425 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe799f-f52d-49bd-93a1-2bab124f961d None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:29.814843 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe799f-f52d-49bd-93a1-2bab124f961d None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:29.815277 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe799f-f52d-49bd-93a1-2bab124f961d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:29.819155 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347adce-b0df-4e96-b69f-4fd8ec5ddbfe None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:29.823188 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafe799f-f52d-49bd-93a1-2bab124f961d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:29.824812 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafe799f-f52d-49bd-93a1-2bab124f961d None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:29.836433 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-aafe799f-f52d-49bd-93a1-2bab124f961d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:52:29.836433 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:29.836433 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:29.836433 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:29.836433 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:29.836433 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:29.836433 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:29.836433 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:29.836433 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:29.836433 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:29.836433 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:29.836433 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:29.836433 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:52:29.836433 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:52:29.836433 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:52:29.838114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:52:29.838114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:29.838114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:29.838114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:29.838114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:29.838114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:29.838114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:29.838114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:29.838114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:29.838114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:29.838114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:29.838114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:29.838114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:29.838114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:29.838114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:29.838114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:29.838114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:29.839128 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:52:29.839128 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:52:29.839128 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:52:29.839128 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:52:29.839128 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:52:29.839128 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:52:29.839128 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:52:29.839128 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:29.841123 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 269/529] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 27 18:52:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:29.842115 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe799f-f52d-49bd-93a1-2bab124f961d None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:29.863129 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de155304-ddc8-4e97-a81b-3dec7fea6d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:29.863791 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de155304-ddc8-4e97-a81b-3dec7fea6d79 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:29.864075 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de155304-ddc8-4e97-a81b-3dec7fea6d79 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:29.864349 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de155304-ddc8-4e97-a81b-3dec7fea6d79 None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:29.865046 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de155304-ddc8-4e97-a81b-3dec7fea6d79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:29.865349 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de155304-ddc8-4e97-a81b-3dec7fea6d79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:29.867205 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de155304-ddc8-4e97-a81b-3dec7fea6d79 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:29.882864 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 261/530] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:52:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:29.884344 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de155304-ddc8-4e97-a81b-3dec7fea6d79 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:29.974381 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe799f-f52d-49bd-93a1-2bab124f961d None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:29.977597 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:29.993902 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de155304-ddc8-4e97-a81b-3dec7fea6d79 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:30.017127 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045546b5-d504-4c59-a1a1-cea82b167074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:30.018146 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045546b5-d504-4c59-a1a1-cea82b167074 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:30.018618 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045546b5-d504-4c59-a1a1-cea82b167074 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:30.019105 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045546b5-d504-4c59-a1a1-cea82b167074 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:30.022370 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:30.042817 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa152484-65e7-42c1-9c30-42d98870e1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:30.043351 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa152484-65e7-42c1-9c30-42d98870e1f8 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:30.043628 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa152484-65e7-42c1-9c30-42d98870e1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:30.043924 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa152484-65e7-42c1-9c30-42d98870e1f8 None admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:30.044679 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa152484-65e7-42c1-9c30-42d98870e1f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:30.044984 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa152484-65e7-42c1-9c30-42d98870e1f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:30.047399 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa152484-65e7-42c1-9c30-42d98870e1f8 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:30.068979 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 262/531] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 27 18:52:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:30.070103 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa152484-65e7-42c1-9c30-42d98870e1f8 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:30.105722 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045546b5-d504-4c59-a1a1-cea82b167074 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:30.107521 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045546b5-d504-4c59-a1a1-cea82b167074 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:30.204188 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa152484-65e7-42c1-9c30-42d98870e1f8 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:30.218169 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 270/532] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 27 18:52:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:52:30.219464 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045546b5-d504-4c59-a1a1-cea82b167074 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:30.223784 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:30.253729 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f9d872-20a7-49a5-a86a-28fc732e3bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:30.254367 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f9d872-20a7-49a5-a86a-28fc732e3bdf None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:30.254648 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f9d872-20a7-49a5-a86a-28fc732e3bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:30.254920 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f9d872-20a7-49a5-a86a-28fc732e3bdf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:30.263880 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f9d872-20a7-49a5-a86a-28fc732e3bdf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:30.265766 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f9d872-20a7-49a5-a86a-28fc732e3bdf None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:30.282596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-64f9d872-20a7-49a5-a86a-28fc732e3bdf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:52:30.282596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:30.282596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:30.282596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:30.282596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:30.282596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:30.282596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:30.282596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:30.282596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:30.282596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:30.282596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:30.282596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:30.282596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:52:30.282596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:52:30.282596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:52:30.283414 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:52:30.283414 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:30.283414 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:30.283414 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:30.283414 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:30.283414 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:30.283414 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:30.283414 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:30.283414 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:30.283414 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:30.283414 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:30.283414 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:30.283414 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:30.283414 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:30.283414 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:30.283414 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:30.283414 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:30.284274 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:52:30.284274 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:52:30.284274 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:52:30.284274 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:52:30.284274 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:52:30.284274 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:52:30.284274 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:52:30.284274 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:30.284274 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 263/533] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 27 18:52:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:30.285155 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f9d872-20a7-49a5-a86a-28fc732e3bdf None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:30.327673 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045546b5-d504-4c59-a1a1-cea82b167074 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:30.334776 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:30.364066 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11029337-3ff1-4125-a727-34c3fd43d902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:30.365154 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11029337-3ff1-4125-a727-34c3fd43d902 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:30.365646 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11029337-3ff1-4125-a727-34c3fd43d902 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:30.366106 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11029337-3ff1-4125-a727-34c3fd43d902 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:30.367102 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11029337-3ff1-4125-a727-34c3fd43d902 None admin] RBAC: Adding query filter params (role.id=306da3282d854292a7a53b8642ee373b, scope.project.id=31f027c53398443eb548eaf3f24523e0, user.id=6c4b9109e80b4ae19a7c31de1cd9d2b9) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:30.367615 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11029337-3ff1-4125-a727-34c3fd43d902 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:30.369284 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11029337-3ff1-4125-a727-34c3fd43d902 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:30.375745 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 271/534] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 27 18:52:30 2022] GET /identity/v3/role_assignments?user.id=6c4b9109e80b4ae19a7c31de1cd9d2b9&scope.project.id=31f027c53398443eb548eaf3f24523e0&role.id=306da3282d854292a7a53b8642ee373b => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:30.376789 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11029337-3ff1-4125-a727-34c3fd43d902 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:30.419647 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f9d872-20a7-49a5-a86a-28fc732e3bdf None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:30.448430 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:30.485993 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11029337-3ff1-4125-a727-34c3fd43d902 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:30.493434 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3211b8-04c0-4f06-88af-3d3642512beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:30.494157 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3211b8-04c0-4f06-88af-3d3642512beb None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:30.494364 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3211b8-04c0-4f06-88af-3d3642512beb None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:30.494637 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3211b8-04c0-4f06-88af-3d3642512beb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:30.521118 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3211b8-04c0-4f06-88af-3d3642512beb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:30.521118 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3211b8-04c0-4f06-88af-3d3642512beb None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:30.537708 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b771ea-2a2f-429f-b19b-a861ef1fb76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:30.538679 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b771ea-2a2f-429f-b19b-a861ef1fb76d None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:30.539175 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b771ea-2a2f-429f-b19b-a861ef1fb76d None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:30.539640 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b771ea-2a2f-429f-b19b-a861ef1fb76d None admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:30.540893 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b771ea-2a2f-429f-b19b-a861ef1fb76d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:30.541425 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b771ea-2a2f-429f-b19b-a861ef1fb76d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:30.543145 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b771ea-2a2f-429f-b19b-a861ef1fb76d None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:30.549810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-2a3211b8-04c0-4f06-88af-3d3642512beb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:30.549810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:30.549810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:30.549810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:30.549810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:30.549810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:30.549810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:30.549810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:30.549810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:30.549810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:30.549810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:30.549810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:30.549810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:52:30.549810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:52:30.549810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:52:30.550667 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:52:30.550667 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:30.550667 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:30.550667 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:30.550667 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:30.550667 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:30.550667 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:30.550667 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:30.550667 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:30.550667 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:30.550667 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:30.550667 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:30.550667 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:30.550667 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:30.550667 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:30.550667 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:30.550667 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:30.551494 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:52:30.551494 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:52:30.551494 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:30.551494 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:30.555680 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 264/535] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:52:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:30.559297 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 272/536] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 27 18:52:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:30.560695 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3211b8-04c0-4f06-88af-3d3642512beb None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:30.565347 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b771ea-2a2f-429f-b19b-a861ef1fb76d None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:30.684065 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b771ea-2a2f-429f-b19b-a861ef1fb76d None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:30.692185 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:30.694545 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3211b8-04c0-4f06-88af-3d3642512beb None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:30.713751 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:30.721842 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b0677-10b1-400d-946e-04c572fe1b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:30.722658 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b0677-10b1-400d-946e-04c572fe1b5b None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:30.723076 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b0677-10b1-400d-946e-04c572fe1b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:30.723517 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b0677-10b1-400d-946e-04c572fe1b5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:30.724466 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b0677-10b1-400d-946e-04c572fe1b5b None admin] RBAC: Adding query filter params (role.id=306da3282d854292a7a53b8642ee373b, scope.project.id=31f027c53398443eb548eaf3f24523e0, user.id=d5525865e12c41fe8da761cd25c14e2e) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:30.724911 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b0677-10b1-400d-946e-04c572fe1b5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:30.726992 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b0677-10b1-400d-946e-04c572fe1b5b None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:30.734334 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeea2b0-2281-47b0-8d2d-62c260e3315b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:30.734590 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 273/537] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 27 18:52:30 2022] GET /identity/v3/role_assignments?user.id=d5525865e12c41fe8da761cd25c14e2e&scope.project.id=31f027c53398443eb548eaf3f24523e0&role.id=306da3282d854292a7a53b8642ee373b => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:52:30.735110 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeea2b0-2281-47b0-8d2d-62c260e3315b None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:30.735460 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeea2b0-2281-47b0-8d2d-62c260e3315b None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:30.736073 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeea2b0-2281-47b0-8d2d-62c260e3315b None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:30.736913 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeea2b0-2281-47b0-8d2d-62c260e3315b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:30.737286 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeea2b0-2281-47b0-8d2d-62c260e3315b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:30.738782 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeea2b0-2281-47b0-8d2d-62c260e3315b None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:30.758657 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 265/538] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:52:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:30.760218 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b0677-10b1-400d-946e-04c572fe1b5b None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:30.892941 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b0677-10b1-400d-946e-04c572fe1b5b None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:30.930006 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b099ed-9ba7-4883-a67c-c72f732efa2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:30.931077 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b099ed-9ba7-4883-a67c-c72f732efa2a None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:30.931529 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b099ed-9ba7-4883-a67c-c72f732efa2a None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:30.931992 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b099ed-9ba7-4883-a67c-c72f732efa2a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:30.939259 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b099ed-9ba7-4883-a67c-c72f732efa2a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:30.941061 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b099ed-9ba7-4883-a67c-c72f732efa2a None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:30.957225 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-d4b099ed-9ba7-4883-a67c-c72f732efa2a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:52:30.957225 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:30.957225 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:30.957225 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:30.957225 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:30.957225 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:30.957225 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:30.957225 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:30.957225 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:30.957225 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:30.957225 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:30.957225 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:30.957225 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:52:30.957225 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:52:30.957225 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:52:30.958085 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:52:30.958085 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:30.958085 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:30.958085 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:30.958085 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:30.958085 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:30.958085 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:30.958085 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:30.958085 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:30.958085 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:30.958085 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:30.958085 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:30.958085 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:30.958085 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:30.958085 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:30.958085 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:30.958085 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:30.958907 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:52:30.958907 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:52:30.958907 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:52:30.958907 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:52:30.958907 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:52:30.958907 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:52:30.958907 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:52:30.958907 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:30.960690 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 274/539] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 27 18:52:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:30.967092 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeea2b0-2281-47b0-8d2d-62c260e3315b None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:31.081563 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeea2b0-2281-47b0-8d2d-62c260e3315b None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:31.100023 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb445c-a3d6-4b6c-837d-ce4cfaf9e11e None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:31.100360 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb445c-a3d6-4b6c-837d-ce4cfaf9e11e None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:31.100577 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb445c-a3d6-4b6c-837d-ce4cfaf9e11e None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:31.102184 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 275/540] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:52:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:52:31.107943 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac8a8a-8692-402d-bc8c-672dab20683b None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:31.108232 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac8a8a-8692-402d-bc8c-672dab20683b None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:31.108513 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac8a8a-8692-402d-bc8c-672dab20683b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:31.119109 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1baeed-9e1d-4592-b38c-d7986f325b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:31.119813 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1baeed-9e1d-4592-b38c-d7986f325b48 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:31.120020 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1baeed-9e1d-4592-b38c-d7986f325b48 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:31.120290 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1baeed-9e1d-4592-b38c-d7986f325b48 None admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:31.121041 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1baeed-9e1d-4592-b38c-d7986f325b48 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:31.121342 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1baeed-9e1d-4592-b38c-d7986f325b48 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:31.122791 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1baeed-9e1d-4592-b38c-d7986f325b48 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:31.141705 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 266/541] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 27 18:52:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:31.143026 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1baeed-9e1d-4592-b38c-d7986f325b48 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:31.150042 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-65ac8a8a-8692-402d-bc8c-672dab20683b None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:31.151237 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-65ac8a8a-8692-402d-bc8c-672dab20683b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:31.159614 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:31.270068 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1baeed-9e1d-4592-b38c-d7986f325b48 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:31.281177 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:31.313150 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f03063-edbb-446a-98fa-7db41994f3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:31.314465 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f03063-edbb-446a-98fa-7db41994f3e9 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:31.315425 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f03063-edbb-446a-98fa-7db41994f3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:31.316889 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 276/542] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:52:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:52:31.317371 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f03063-edbb-446a-98fa-7db41994f3e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:31.318369 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f03063-edbb-446a-98fa-7db41994f3e9 None admin] RBAC: Adding query filter params (role.id=306da3282d854292a7a53b8642ee373b, scope.project.id=31f027c53398443eb548eaf3f24523e0, user.id=703f0431d017405d942539de93a565b7) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:31.318894 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f03063-edbb-446a-98fa-7db41994f3e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:31.320594 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f03063-edbb-446a-98fa-7db41994f3e9 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:31.328284 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 267/543] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 27 18:52:31 2022] GET /identity/v3/role_assignments?user.id=703f0431d017405d942539de93a565b7&scope.project.id=31f027c53398443eb548eaf3f24523e0&role.id=306da3282d854292a7a53b8642ee373b => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:52:31.343821 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac8a8a-8692-402d-bc8c-672dab20683b None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:31.492673 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac8a8a-8692-402d-bc8c-672dab20683b None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:31.557966 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d37eb-fcab-4cb1-b2e7-e9c6ece89a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:31.558610 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d37eb-fcab-4cb1-b2e7-e9c6ece89a58 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:31.558887 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d37eb-fcab-4cb1-b2e7-e9c6ece89a58 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:31.559159 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d37eb-fcab-4cb1-b2e7-e9c6ece89a58 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:31.566301 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0f0e7-27b0-44f2-bf38-aa61d881f6d1 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:31.566818 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0f0e7-27b0-44f2-bf38-aa61d881f6d1 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:31.566818 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0f0e7-27b0-44f2-bf38-aa61d881f6d1 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:31.568237 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 268/544] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:52:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:52:31.574253 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd291b6-07f4-406a-9895-32c65042748e None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:31.574529 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd291b6-07f4-406a-9895-32c65042748e None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:31.574812 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd291b6-07f4-406a-9895-32c65042748e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:31.589354 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576d37eb-fcab-4cb1-b2e7-e9c6ece89a58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:52:31.599861 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-576d37eb-fcab-4cb1-b2e7-e9c6ece89a58 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:52:31.599861 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:31.599861 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:31.599861 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:31.599861 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:31.599861 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:31.599861 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:31.599861 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:31.599861 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:31.599861 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:31.599861 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:31.599861 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:31.599861 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:52:31.599861 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:52:31.599861 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:52:31.599861 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:52:31.600827 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:52:31.600827 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:52:31.600827 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:52:31.600827 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:52:31.600827 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:31.600827 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:31.600827 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:31.600827 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:31.600827 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:31.600827 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:31.600827 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:31.600827 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:31.600827 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:31.600827 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:31.600827 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:31.600827 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:31.601605 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:31.601605 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:31.601605 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:31.601605 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:31.601605 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:52:31.601605 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:52:31.601605 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:52:31.601605 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:52:31.601605 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:52:31.601605 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:52:31.601605 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:52:31.601605 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:31.608120 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 277/545] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 27 18:52:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:31.610168 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-6fd291b6-07f4-406a-9895-32c65042748e None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:31.611662 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-6fd291b6-07f4-406a-9895-32c65042748e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:31.625718 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d37eb-fcab-4cb1-b2e7-e9c6ece89a58 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:31.696714 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:31.706002 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 269/546] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:52:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:52:31.737795 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd291b6-07f4-406a-9895-32c65042748e None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:31.754465 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:31.775085 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d37eb-fcab-4cb1-b2e7-e9c6ece89a58 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:31.810205 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798e404d-836b-42fc-8c0b-c071302c5c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:31.811157 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e404d-836b-42fc-8c0b-c071302c5c01 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:31.811652 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e404d-836b-42fc-8c0b-c071302c5c01 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:31.812148 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e404d-836b-42fc-8c0b-c071302c5c01 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:31.813051 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798e404d-836b-42fc-8c0b-c071302c5c01 None admin] RBAC: Adding query filter params (name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:31.813550 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798e404d-836b-42fc-8c0b-c071302c5c01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:31.815121 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798e404d-836b-42fc-8c0b-c071302c5c01 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:31.824243 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 278/547] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Jul 27 18:52:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:52:31.832656 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798e404d-836b-42fc-8c0b-c071302c5c01 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:31.932354 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd291b6-07f4-406a-9895-32c65042748e None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:32.002218 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3385b49-be62-436a-b3e3-55d76873ba9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:32.002868 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3385b49-be62-436a-b3e3-55d76873ba9f None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:32.003149 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3385b49-be62-436a-b3e3-55d76873ba9f None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:32.003422 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3385b49-be62-436a-b3e3-55d76873ba9f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:32.022686 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3385b49-be62-436a-b3e3-55d76873ba9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:52:32.028369 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-b3385b49-be62-436a-b3e3-55d76873ba9f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:52:32.028369 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:32.028369 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:32.028369 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:32.028369 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:32.028369 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:32.028369 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:32.028369 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:32.028369 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:32.028369 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:32.028369 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:32.028369 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:32.028369 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:52:32.028369 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:52:32.028369 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:52:32.028369 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:52:32.029293 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:52:32.029293 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:52:32.029293 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:52:32.029293 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:52:32.029293 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:32.029293 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:32.029293 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:32.029293 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:32.029293 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:32.029293 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:32.029293 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:32.029293 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:32.029293 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:32.029293 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:32.029293 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:32.029293 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:32.030499 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:32.030499 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:32.030499 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:32.030499 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:32.030499 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:52:32.030499 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:52:32.030499 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:52:32.030499 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:52:32.030499 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:52:32.030499 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:52:32.030499 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:52:32.030499 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:32.030499 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 270/548] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 27 18:52:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:52:32.035841 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3385b49-be62-436a-b3e3-55d76873ba9f None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:32.050922 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798e404d-836b-42fc-8c0b-c071302c5c01 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:32.057347 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:32.116368 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a9483-3c44-415d-aec7-5b684d742919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:32.117308 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a9483-3c44-415d-aec7-5b684d742919 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:32.117805 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a9483-3c44-415d-aec7-5b684d742919 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:32.118276 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a9483-3c44-415d-aec7-5b684d742919 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:32.140437 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3a9483-3c44-415d-aec7-5b684d742919 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:32.143789 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3a9483-3c44-415d-aec7-5b684d742919 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:32.157713 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:32.167794 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-be3a9483-3c44-415d-aec7-5b684d742919 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:32.167794 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:32.167794 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:32.167794 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:32.167794 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:32.167794 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:32.167794 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:32.167794 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:32.167794 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:32.167794 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:32.167794 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:32.167794 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:32.167794 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:52:32.167794 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:52:32.167794 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:52:32.168659 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:52:32.168659 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:32.168659 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:32.168659 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:32.168659 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:32.168659 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:32.168659 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:32.168659 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:32.168659 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:32.168659 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:32.168659 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:32.168659 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:32.168659 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:32.168659 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:32.168659 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:32.168659 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:32.168659 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:32.170151 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:52:32.170151 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:52:32.170151 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:32.170151 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:32.176021 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 279/549] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:52:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:32.176854 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a9483-3c44-415d-aec7-5b684d742919 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:32.199383 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3385b49-be62-436a-b3e3-55d76873ba9f None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:32.236880 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f931b73-e759-420b-826e-9d8348e32f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:32.237826 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f931b73-e759-420b-826e-9d8348e32f36 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:32.238338 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f931b73-e759-420b-826e-9d8348e32f36 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:32.238783 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f931b73-e759-420b-826e-9d8348e32f36 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:32.239733 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f931b73-e759-420b-826e-9d8348e32f36 None admin] RBAC: Adding query filter params (name=service) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:32.240209 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f931b73-e759-420b-826e-9d8348e32f36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:32.241756 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f931b73-e759-420b-826e-9d8348e32f36 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:32.250463 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 271/550] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Jul 27 18:52:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:32.258108 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f931b73-e759-420b-826e-9d8348e32f36 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:32.367554 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a9483-3c44-415d-aec7-5b684d742919 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:32.431222 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6501f1cc-fc0c-4d67-8e81-3949241555de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:32.432334 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501f1cc-fc0c-4d67-8e81-3949241555de None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:32.432789 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501f1cc-fc0c-4d67-8e81-3949241555de None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:32.433252 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501f1cc-fc0c-4d67-8e81-3949241555de None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:32.434116 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6501f1cc-fc0c-4d67-8e81-3949241555de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:32.435339 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6501f1cc-fc0c-4d67-8e81-3949241555de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:32.436920 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6501f1cc-fc0c-4d67-8e81-3949241555de None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:32.443439 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f931b73-e759-420b-826e-9d8348e32f36 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:32.465670 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 280/551] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:52:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:32.471146 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6501f1cc-fc0c-4d67-8e81-3949241555de None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:32.496041 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:32.503752 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:32.513107 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1921fc29-4fa1-4ec5-ac5c-b25a80c3bdcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:32.513754 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921fc29-4fa1-4ec5-ac5c-b25a80c3bdcd None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:32.514030 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921fc29-4fa1-4ec5-ac5c-b25a80c3bdcd None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:32.514299 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921fc29-4fa1-4ec5-ac5c-b25a80c3bdcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:32.535153 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1921fc29-4fa1-4ec5-ac5c-b25a80c3bdcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:32.536650 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1921fc29-4fa1-4ec5-ac5c-b25a80c3bdcd None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:32.563326 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-1921fc29-4fa1-4ec5-ac5c-b25a80c3bdcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:32.563326 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:32.563326 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:32.563326 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:32.563326 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:32.563326 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:32.563326 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:32.563326 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:32.563326 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:32.563326 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:32.563326 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:32.563326 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:32.563326 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:52:32.563326 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:52:32.563326 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:52:32.564331 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:52:32.564331 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:32.564331 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:32.564331 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:32.564331 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:32.564331 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:32.564331 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:32.564331 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:32.564331 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:32.564331 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:32.564331 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:32.564331 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:32.564331 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:32.564331 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:32.564331 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:32.564331 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:32.564331 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:32.565283 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:52:32.565283 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:52:32.565283 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:32.565283 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:32.566517 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 272/552] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:52:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:32.570173 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1921fc29-4fa1-4ec5-ac5c-b25a80c3bdcd None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:32.670825 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6501f1cc-fc0c-4d67-8e81-3949241555de None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:32.741271 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a36d3c-98b0-46ee-a1a8-acff1c9d8050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:32.741941 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a36d3c-98b0-46ee-a1a8-acff1c9d8050 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:32.742186 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a36d3c-98b0-46ee-a1a8-acff1c9d8050 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:32.742460 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a36d3c-98b0-46ee-a1a8-acff1c9d8050 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:32.759439 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a36d3c-98b0-46ee-a1a8-acff1c9d8050 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:32.760936 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a36d3c-98b0-46ee-a1a8-acff1c9d8050 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:32.777322 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1921fc29-4fa1-4ec5-ac5c-b25a80c3bdcd None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:32.789261 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-f4a36d3c-98b0-46ee-a1a8-acff1c9d8050 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 18:52:32.789261 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:32.789261 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:32.789261 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:32.789261 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:32.789261 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:32.789261 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:32.789261 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:32.789261 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:32.789261 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:32.789261 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:32.789261 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:32.789261 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:52:32.789261 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:52:32.789261 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:52:32.789261 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:52:32.790944 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:32.790944 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:32.790944 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:52:32.790944 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:52:32.790944 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:52:32.790944 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:52:32.790944 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:32.790944 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:32.790944 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:32.790944 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:32.790944 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:32.790944 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:32.790944 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:32.790944 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:32.790944 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:32.790944 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:32.790944 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:32.790944 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:32.792034 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:32.792034 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:32.792034 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:52:32.792034 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:52:32.792034 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:52:32.792034 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:52:32.792034 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:52:32.792034 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:52:32.792034 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 18:52:32.792034 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:32.801490 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 281/553] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 27 18:52:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:52:32.813546 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a36d3c-98b0-46ee-a1a8-acff1c9d8050 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:32.859074 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab19037-8b43-4780-a3ef-ac4964a60092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:32.859831 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab19037-8b43-4780-a3ef-ac4964a60092 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:32.860112 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab19037-8b43-4780-a3ef-ac4964a60092 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:32.860379 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab19037-8b43-4780-a3ef-ac4964a60092 None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:32.861425 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab19037-8b43-4780-a3ef-ac4964a60092 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:32.861729 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab19037-8b43-4780-a3ef-ac4964a60092 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:32.863105 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab19037-8b43-4780-a3ef-ac4964a60092 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:32.889218 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 273/554] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:52:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:32.900839 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab19037-8b43-4780-a3ef-ac4964a60092 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:32.907260 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:32.948092 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a36d3c-98b0-46ee-a1a8-acff1c9d8050 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:32.969085 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:32.984629 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e3b685-a91e-4069-97b0-18c8e9f5347a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:32.985346 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3b685-a91e-4069-97b0-18c8e9f5347a None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:32.985877 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3b685-a91e-4069-97b0-18c8e9f5347a None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:32.986146 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3b685-a91e-4069-97b0-18c8e9f5347a None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:32.986936 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e3b685-a91e-4069-97b0-18c8e9f5347a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:32.987241 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e3b685-a91e-4069-97b0-18c8e9f5347a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:32.988859 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e3b685-a91e-4069-97b0-18c8e9f5347a None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:33.008977 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 282/555] 10.222.0.20 () {56 vars in 1135 bytes} [Wed Jul 27 18:52:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:33.010253 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e281bc-d0d1-4f42-83ba-b1074a223098 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:33.010538 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e281bc-d0d1-4f42-83ba-b1074a223098 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:33.010810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e281bc-d0d1-4f42-83ba-b1074a223098 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:33.016043 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 283/556] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:52:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:52:33.016043 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e281bc-d0d1-4f42-83ba-b1074a223098 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:33.041720 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab19037-8b43-4780-a3ef-ac4964a60092 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:33.078334 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba4cb4-0261-4ebd-b45a-31c6acd7a2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:33.078977 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba4cb4-0261-4ebd-b45a-31c6acd7a2e6 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:33.079519 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba4cb4-0261-4ebd-b45a-31c6acd7a2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:33.079864 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba4cb4-0261-4ebd-b45a-31c6acd7a2e6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:33.089673 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ba4cb4-0261-4ebd-b45a-31c6acd7a2e6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:33.091108 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ba4cb4-0261-4ebd-b45a-31c6acd7a2e6 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:33.103618 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-53ba4cb4-0261-4ebd-b45a-31c6acd7a2e6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 18:52:33.103618 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:33.103618 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:33.103618 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:33.103618 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:33.103618 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:33.103618 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:33.103618 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:33.103618 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:33.103618 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:33.103618 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:33.103618 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:33.103618 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:52:33.103618 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:52:33.103618 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:52:33.103618 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:52:33.104953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:33.104953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:33.104953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:52:33.104953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:52:33.104953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:52:33.104953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:52:33.104953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:33.104953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:33.104953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:33.104953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:33.104953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:33.104953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:33.104953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:33.104953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:33.104953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:33.104953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:33.104953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:33.104953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:33.106434 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:33.106434 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:33.106434 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:52:33.106434 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:52:33.106434 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:52:33.106434 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:52:33.106434 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:52:33.106434 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:52:33.106434 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 18:52:33.106434 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:33.106434 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 274/557] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Jul 27 18:52:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:33.106434 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0387d6-f3a3-4423-9eb4-e8433c24e88e None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:33.106434 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0387d6-f3a3-4423-9eb4-e8433c24e88e None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:33.107124 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0387d6-f3a3-4423-9eb4-e8433c24e88e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:33.124140 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-3c0387d6-f3a3-4423-9eb4-e8433c24e88e None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:33.125478 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-3c0387d6-f3a3-4423-9eb4-e8433c24e88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:33.128637 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e281bc-d0d1-4f42-83ba-b1074a223098 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:33.165969 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d2b381-d8cb-480e-a014-df66c67a485a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:33.166577 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d2b381-d8cb-480e-a014-df66c67a485a None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:33.166860 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d2b381-d8cb-480e-a014-df66c67a485a None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:33.167542 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d2b381-d8cb-480e-a014-df66c67a485a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:33.170706 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:33.203779 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 275/558] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:52:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:52:33.203779 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7645266f-fcf3-4107-944a-69049f11740b None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:33.203779 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7645266f-fcf3-4107-944a-69049f11740b None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:33.203779 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7645266f-fcf3-4107-944a-69049f11740b None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:33.203779 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 276/559] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:52:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:52:33.203779 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7645266f-fcf3-4107-944a-69049f11740b None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:33.238100 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:33.259201 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d2b381-d8cb-480e-a014-df66c67a485a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:33.260818 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d2b381-d8cb-480e-a014-df66c67a485a None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:33.313030 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7645266f-fcf3-4107-944a-69049f11740b None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:33.345706 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeafdce6-3646-40d2-92f1-ab5430bb5892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:33.346323 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeafdce6-3646-40d2-92f1-ab5430bb5892 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:33.346598 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeafdce6-3646-40d2-92f1-ab5430bb5892 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:33.346866 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeafdce6-3646-40d2-92f1-ab5430bb5892 None admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:33.347654 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeafdce6-3646-40d2-92f1-ab5430bb5892 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:33.347986 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeafdce6-3646-40d2-92f1-ab5430bb5892 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:33.349419 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeafdce6-3646-40d2-92f1-ab5430bb5892 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:33.366860 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 284/560] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 27 18:52:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:52:33.368628 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc38b2c-ff26-4660-be93-78ca1f67166b None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:33.369081 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc38b2c-ff26-4660-be93-78ca1f67166b None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:33.369552 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc38b2c-ff26-4660-be93-78ca1f67166b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:33.371452 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 277/561] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Jul 27 18:52:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:33.372386 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeafdce6-3646-40d2-92f1-ab5430bb5892 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:33.388794 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-5fc38b2c-ff26-4660-be93-78ca1f67166b None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:33.390444 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-5fc38b2c-ff26-4660-be93-78ca1f67166b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:33.419205 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:33.464198 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:33.465895 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 285/562] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:52:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:52:33.466813 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc38b2c-ff26-4660-be93-78ca1f67166b None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:33.486309 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeafdce6-3646-40d2-92f1-ab5430bb5892 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:33.521632 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f861815-8d27-4d9f-beb0-c0ff5ef548c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:33.522651 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f861815-8d27-4d9f-beb0-c0ff5ef548c9 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:33.523127 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f861815-8d27-4d9f-beb0-c0ff5ef548c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:33.523609 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f861815-8d27-4d9f-beb0-c0ff5ef548c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:33.537858 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f861815-8d27-4d9f-beb0-c0ff5ef548c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:52:33.543235 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-7f861815-8d27-4d9f-beb0-c0ff5ef548c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:52:33.543235 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:33.543235 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:33.543235 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:33.543235 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:33.543235 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:33.543235 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:33.543235 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:33.543235 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:33.543235 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:33.543235 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:33.543235 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:33.543235 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:52:33.543235 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:52:33.543235 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:52:33.543235 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:52:33.544172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:52:33.544172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:52:33.544172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:52:33.544172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:52:33.544172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:33.544172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:33.544172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:33.544172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:33.544172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:33.544172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:33.544172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:33.544172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:33.544172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:33.544172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:33.544172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:33.544172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:33.545717 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:33.545717 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:33.545717 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:33.545717 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:33.545717 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:52:33.545717 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:52:33.545717 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:52:33.545717 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:52:33.545717 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:52:33.545717 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:52:33.545717 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:52:33.545717 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:33.545717 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 278/563] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 27 18:52:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:33.545717 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f861815-8d27-4d9f-beb0-c0ff5ef548c9 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:33.581092 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc38b2c-ff26-4660-be93-78ca1f67166b None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:33.616796 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aace9ac9-7813-42ce-83c7-6e7b23bcff9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:33.617430 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace9ac9-7813-42ce-83c7-6e7b23bcff9f None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:33.617712 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace9ac9-7813-42ce-83c7-6e7b23bcff9f None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:33.618908 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace9ac9-7813-42ce-83c7-6e7b23bcff9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:33.629708 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aace9ac9-7813-42ce-83c7-6e7b23bcff9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:33.631128 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aace9ac9-7813-42ce-83c7-6e7b23bcff9f None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:33.645831 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-aace9ac9-7813-42ce-83c7-6e7b23bcff9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:33.645831 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:33.645831 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:33.645831 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:33.645831 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:33.645831 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:33.645831 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:33.645831 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:33.645831 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:33.645831 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:33.645831 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:33.645831 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:33.645831 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:52:33.645831 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:52:33.645831 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:52:33.646694 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:52:33.646694 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:33.646694 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:33.646694 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:33.646694 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:33.646694 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:33.646694 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:33.646694 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:33.646694 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:33.646694 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:33.646694 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:33.646694 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:33.646694 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:33.646694 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:33.646694 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:33.646694 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:33.646694 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:33.647594 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:52:33.647594 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:52:33.647594 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:33.647594 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:33.647594 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 286/564] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:52:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:33.647905 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aace9ac9-7813-42ce-83c7-6e7b23bcff9f None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:33.654147 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f861815-8d27-4d9f-beb0-c0ff5ef548c9 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:33.669216 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:33.690180 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac05760-be56-45f0-9a80-e83c3b2f1f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:33.690823 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac05760-be56-45f0-9a80-e83c3b2f1f8d None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:33.691106 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac05760-be56-45f0-9a80-e83c3b2f1f8d None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:33.691377 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac05760-be56-45f0-9a80-e83c3b2f1f8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:33.701441 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac05760-be56-45f0-9a80-e83c3b2f1f8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:33.702894 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac05760-be56-45f0-9a80-e83c3b2f1f8d None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:33.712050 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:33.719647 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-8ac05760-be56-45f0-9a80-e83c3b2f1f8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:33.719647 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:33.719647 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:33.719647 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:33.719647 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:33.719647 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:33.719647 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:33.719647 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:33.719647 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:33.719647 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:33.719647 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:33.719647 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:33.719647 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:52:33.719647 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:52:33.719647 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:52:33.720738 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:52:33.720738 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:33.720738 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:33.720738 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:33.720738 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:33.720738 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:33.720738 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:33.720738 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:33.720738 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:33.720738 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:33.720738 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:33.720738 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:33.720738 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:33.720738 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:33.720738 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:33.720738 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:33.720738 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:33.721853 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:52:33.721853 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:52:33.721853 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:33.721853 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:33.725842 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 279/565] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:52:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:33.726677 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac05760-be56-45f0-9a80-e83c3b2f1f8d None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:33.757761 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aace9ac9-7813-42ce-83c7-6e7b23bcff9f None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:33.791014 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c494c5e3-ad3c-4089-b745-6336fbd8388d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:33.791645 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494c5e3-ad3c-4089-b745-6336fbd8388d None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:33.791955 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494c5e3-ad3c-4089-b745-6336fbd8388d None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:33.792229 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494c5e3-ad3c-4089-b745-6336fbd8388d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:33.802322 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c494c5e3-ad3c-4089-b745-6336fbd8388d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:52:33.808916 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-c494c5e3-ad3c-4089-b745-6336fbd8388d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:52:33.808916 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:33.808916 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:33.808916 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:33.808916 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:33.808916 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:33.808916 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:33.808916 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:33.808916 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:33.808916 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:33.808916 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:33.808916 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:33.808916 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:52:33.808916 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:52:33.808916 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:52:33.808916 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:52:33.809811 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:52:33.809811 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:52:33.809811 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:52:33.809811 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:52:33.809811 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:33.809811 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:33.809811 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:33.809811 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:33.809811 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:33.809811 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:33.809811 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:33.809811 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:33.809811 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:33.809811 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:33.809811 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:33.809811 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:33.810638 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:33.810638 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:33.810638 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:33.810638 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:33.810638 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:52:33.810638 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:52:33.810638 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:52:33.810638 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:52:33.810638 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:52:33.810638 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:52:33.810638 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:52:33.810638 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:33.810638 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 287/566] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 27 18:52:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:33.811337 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c494c5e3-ad3c-4089-b745-6336fbd8388d None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:33.827899 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac05760-be56-45f0-9a80-e83c3b2f1f8d None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:33.863553 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520610ed-08bb-4f37-8ef3-52ddd7be1f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:33.864192 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520610ed-08bb-4f37-8ef3-52ddd7be1f6c None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:33.864473 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520610ed-08bb-4f37-8ef3-52ddd7be1f6c None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:33.864747 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520610ed-08bb-4f37-8ef3-52ddd7be1f6c None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:33.865464 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520610ed-08bb-4f37-8ef3-52ddd7be1f6c None admin] RBAC: Adding query filter params (name=service) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:33.865769 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520610ed-08bb-4f37-8ef3-52ddd7be1f6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:33.867136 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520610ed-08bb-4f37-8ef3-52ddd7be1f6c None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:33.877520 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 280/567] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Jul 27 18:52:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:33.878339 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520610ed-08bb-4f37-8ef3-52ddd7be1f6c None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:33.901677 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:33.924827 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c494c5e3-ad3c-4089-b745-6336fbd8388d None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:33.940797 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:33.958479 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fc0b52-d16b-464e-9284-1e30510f7d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:33.959090 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc0b52-d16b-464e-9284-1e30510f7d12 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:33.959369 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc0b52-d16b-464e-9284-1e30510f7d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:33.959642 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc0b52-d16b-464e-9284-1e30510f7d12 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:33.960359 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fc0b52-d16b-464e-9284-1e30510f7d12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:33.960717 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fc0b52-d16b-464e-9284-1e30510f7d12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:33.962655 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fc0b52-d16b-464e-9284-1e30510f7d12 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:33.975408 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 288/568] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:52:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:33.976411 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0a2c5-d4e8-4642-bee4-5027de774d37 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:33.976693 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0a2c5-d4e8-4642-bee4-5027de774d37 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:33.976964 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0a2c5-d4e8-4642-bee4-5027de774d37 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:33.978795 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 289/569] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:52:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:52:33.979477 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0a2c5-d4e8-4642-bee4-5027de774d37 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:33.984606 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520610ed-08bb-4f37-8ef3-52ddd7be1f6c None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:34.018775 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce0de9-8a29-4430-81ad-d95c6e5a5371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:34.019371 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce0de9-8a29-4430-81ad-d95c6e5a5371 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:34.019648 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce0de9-8a29-4430-81ad-d95c6e5a5371 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:34.019946 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce0de9-8a29-4430-81ad-d95c6e5a5371 None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:34.020626 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ce0de9-8a29-4430-81ad-d95c6e5a5371 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:34.020926 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ce0de9-8a29-4430-81ad-d95c6e5a5371 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:34.022280 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ce0de9-8a29-4430-81ad-d95c6e5a5371 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:34.034572 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 281/570] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:52:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:34.035350 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce0de9-8a29-4430-81ad-d95c6e5a5371 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:34.080344 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0a2c5-d4e8-4642-bee4-5027de774d37 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:34.115225 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d1fd38-03c3-42f1-80a1-278698dfcdf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:34.115853 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1fd38-03c3-42f1-80a1-278698dfcdf4 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:34.116130 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1fd38-03c3-42f1-80a1-278698dfcdf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:34.116397 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1fd38-03c3-42f1-80a1-278698dfcdf4 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:34.117095 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d1fd38-03c3-42f1-80a1-278698dfcdf4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:34.117396 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d1fd38-03c3-42f1-80a1-278698dfcdf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:34.118756 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d1fd38-03c3-42f1-80a1-278698dfcdf4 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:34.120878 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:34.127538 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 290/571] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Jul 27 18:52:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:34.128331 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d1fd38-03c3-42f1-80a1-278698dfcdf4 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:34.132466 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce0de9-8a29-4430-81ad-d95c6e5a5371 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:34.155278 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:34.167280 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d385704-19ac-4531-85e5-bdaa2318b405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:34.167937 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d385704-19ac-4531-85e5-bdaa2318b405 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:34.168217 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d385704-19ac-4531-85e5-bdaa2318b405 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:34.168488 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d385704-19ac-4531-85e5-bdaa2318b405 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:34.178171 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d385704-19ac-4531-85e5-bdaa2318b405 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:34.179607 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d385704-19ac-4531-85e5-bdaa2318b405 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:34.193686 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-7d385704-19ac-4531-85e5-bdaa2318b405 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:34.193686 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:34.193686 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:34.193686 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:34.193686 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:34.193686 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:34.193686 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:34.193686 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:34.193686 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:34.193686 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:34.193686 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:34.193686 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:34.193686 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:52:34.193686 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:52:34.193686 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:52:34.194740 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:52:34.194740 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:34.194740 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:34.194740 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:34.194740 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:34.194740 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:34.194740 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:34.194740 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:34.194740 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:34.194740 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:34.194740 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:34.194740 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:34.194740 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:34.194740 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:34.194740 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:34.194740 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:34.194740 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:34.195908 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:52:34.195908 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:52:34.195908 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:34.195908 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:34.195908 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 282/572] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:52:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:34.196839 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64c0e4-edae-42c6-835d-a24941015610 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:34.196839 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64c0e4-edae-42c6-835d-a24941015610 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:34.197003 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64c0e4-edae-42c6-835d-a24941015610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:34.214230 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-0c64c0e4-edae-42c6-835d-a24941015610 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:34.215420 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-0c64c0e4-edae-42c6-835d-a24941015610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:34.236880 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d1fd38-03c3-42f1-80a1-278698dfcdf4 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:34.275365 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce111a2-b449-49a0-a264-3a0e536f761b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:34.276035 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce111a2-b449-49a0-a264-3a0e536f761b None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:34.276318 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce111a2-b449-49a0-a264-3a0e536f761b None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:34.276591 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce111a2-b449-49a0-a264-3a0e536f761b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:34.283258 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce111a2-b449-49a0-a264-3a0e536f761b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:34.284786 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce111a2-b449-49a0-a264-3a0e536f761b None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:34.286815 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 283/573] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:52:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:52:34.299823 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c64c0e4-edae-42c6-835d-a24941015610 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:34.309733 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-5ce111a2-b449-49a0-a264-3a0e536f761b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:52:34.309733 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:34.309733 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:34.309733 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:34.309733 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:34.309733 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:34.309733 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:34.309733 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:34.309733 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:34.309733 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:34.309733 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:34.309733 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:34.309733 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:52:34.309733 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:52:34.309733 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:52:34.310780 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:52:34.310780 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:34.310780 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:34.310780 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:34.310780 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:34.310780 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:34.310780 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:34.310780 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:34.310780 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:34.310780 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:34.310780 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:34.310780 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:34.310780 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:34.310780 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:34.310780 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:34.310780 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:34.310780 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:34.312007 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:52:34.312007 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:52:34.312007 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:52:34.312007 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:52:34.312007 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:52:34.312007 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:52:34.312007 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:52:34.312007 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:34.312007 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 291/574] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 27 18:52:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:34.313442 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce111a2-b449-49a0-a264-3a0e536f761b None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:34.370875 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:34.384399 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c64c0e4-edae-42c6-835d-a24941015610 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:34.386627 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:34.412968 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce111a2-b449-49a0-a264-3a0e536f761b None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:34.418488 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d926675-f749-4b64-8887-89e2eae33bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:34.419121 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d926675-f749-4b64-8887-89e2eae33bb7 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:34.419402 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d926675-f749-4b64-8887-89e2eae33bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:34.419710 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d926675-f749-4b64-8887-89e2eae33bb7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:34.426189 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d926675-f749-4b64-8887-89e2eae33bb7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:34.427625 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d926675-f749-4b64-8887-89e2eae33bb7 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:34.438704 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-8d926675-f749-4b64-8887-89e2eae33bb7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:52:34.438704 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:34.438704 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:34.438704 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:34.438704 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:34.438704 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:34.438704 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:34.438704 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:34.438704 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:34.438704 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:34.438704 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:34.438704 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:34.438704 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:52:34.438704 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:52:34.438704 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:52:34.439760 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:52:34.439760 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:34.439760 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:34.439760 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:34.439760 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:34.439760 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:34.439760 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:34.439760 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:34.439760 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:34.439760 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:34.439760 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:34.439760 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:34.439760 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:34.439760 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:34.439760 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:34.439760 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:34.439760 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:34.440803 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:52:34.440803 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:52:34.440803 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:52:34.440803 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:52:34.440803 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:52:34.440803 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:52:34.440803 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:52:34.440803 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:34.440803 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 284/575] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 27 18:52:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:34.440803 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d926675-f749-4b64-8887-89e2eae33bb7 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:34.448466 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f361f0b-a6d7-4d12-888f-cc1ddb3b17e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:34.449096 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f361f0b-a6d7-4d12-888f-cc1ddb3b17e6 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:34.449377 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f361f0b-a6d7-4d12-888f-cc1ddb3b17e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:34.449651 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f361f0b-a6d7-4d12-888f-cc1ddb3b17e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:34.460017 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f361f0b-a6d7-4d12-888f-cc1ddb3b17e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:34.461455 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f361f0b-a6d7-4d12-888f-cc1ddb3b17e6 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:34.475679 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-5f361f0b-a6d7-4d12-888f-cc1ddb3b17e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:34.475679 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:34.475679 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:34.475679 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:34.475679 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:34.475679 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:34.475679 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:34.475679 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:34.475679 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:34.475679 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:34.475679 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:34.475679 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:34.475679 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:52:34.475679 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:52:34.475679 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:52:34.476709 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:52:34.476709 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:34.476709 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:34.476709 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:34.476709 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:34.476709 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:34.476709 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:34.476709 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:34.476709 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:34.476709 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:34.476709 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:34.476709 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:34.476709 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:34.476709 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:34.476709 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:34.476709 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:34.476709 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:34.477628 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:52:34.477628 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:52:34.477628 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:34.477628 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:34.477628 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 292/576] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:52:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:34.477628 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f361f0b-a6d7-4d12-888f-cc1ddb3b17e6 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:34.546001 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d926675-f749-4b64-8887-89e2eae33bb7 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:34.580204 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f361f0b-a6d7-4d12-888f-cc1ddb3b17e6 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:34.580393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef8b790-f3dd-4fc7-8758-ebea2ed9a670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:34.581007 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8b790-f3dd-4fc7-8758-ebea2ed9a670 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:34.581310 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8b790-f3dd-4fc7-8758-ebea2ed9a670 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:34.581566 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8b790-f3dd-4fc7-8758-ebea2ed9a670 None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:34.582256 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef8b790-f3dd-4fc7-8758-ebea2ed9a670 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:34.582562 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef8b790-f3dd-4fc7-8758-ebea2ed9a670 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:34.583962 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef8b790-f3dd-4fc7-8758-ebea2ed9a670 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:34.590531 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:34.595227 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 285/577] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:52:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:34.596044 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef8b790-f3dd-4fc7-8758-ebea2ed9a670 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:34.615468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3d8791-45e0-42e8-9edf-4d550b18d5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:34.616138 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d8791-45e0-42e8-9edf-4d550b18d5d3 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:34.616420 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d8791-45e0-42e8-9edf-4d550b18d5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:34.616693 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d8791-45e0-42e8-9edf-4d550b18d5d3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:34.620636 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:34.627350 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3d8791-45e0-42e8-9edf-4d550b18d5d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:52:34.632632 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-8a3d8791-45e0-42e8-9edf-4d550b18d5d3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:52:34.632632 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:34.632632 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:34.632632 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:34.632632 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:34.632632 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:34.632632 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:34.632632 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:34.632632 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:34.632632 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:34.632632 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:34.632632 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:34.632632 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:52:34.632632 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:52:34.632632 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:52:34.632632 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:52:34.634280 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:52:34.634280 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:52:34.634280 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:52:34.634280 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:52:34.634280 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:34.634280 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:34.634280 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:34.634280 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:34.634280 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:34.634280 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:34.634280 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:34.634280 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:34.634280 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:34.634280 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:34.634280 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:34.634280 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:34.635112 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:34.635112 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:34.635112 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:34.635112 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:34.635112 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:52:34.635112 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:52:34.635112 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:52:34.635112 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:52:34.635112 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:52:34.635112 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:52:34.635112 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:52:34.635112 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:34.635112 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 293/578] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 27 18:52:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:34.635112 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3d8791-45e0-42e8-9edf-4d550b18d5d3 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:34.697035 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef8b790-f3dd-4fc7-8758-ebea2ed9a670 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:34.728803 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97100602-bbc5-4214-9731-d05d2b7a8f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:34.729409 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97100602-bbc5-4214-9731-d05d2b7a8f89 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:34.729713 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97100602-bbc5-4214-9731-d05d2b7a8f89 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:34.729983 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97100602-bbc5-4214-9731-d05d2b7a8f89 None admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:34.730718 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97100602-bbc5-4214-9731-d05d2b7a8f89 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:34.731021 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97100602-bbc5-4214-9731-d05d2b7a8f89 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:34.732485 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97100602-bbc5-4214-9731-d05d2b7a8f89 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:34.733259 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3d8791-45e0-42e8-9edf-4d550b18d5d3 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:34.744593 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 286/579] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 27 18:52:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:34.745361 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97100602-bbc5-4214-9731-d05d2b7a8f89 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:34.767166 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93212ddc-ce37-42b7-b774-6c1813bbfe8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:34.767804 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93212ddc-ce37-42b7-b774-6c1813bbfe8c None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:34.768088 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93212ddc-ce37-42b7-b774-6c1813bbfe8c None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:34.768362 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93212ddc-ce37-42b7-b774-6c1813bbfe8c None admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:34.769104 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93212ddc-ce37-42b7-b774-6c1813bbfe8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:34.769411 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93212ddc-ce37-42b7-b774-6c1813bbfe8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:34.770837 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93212ddc-ce37-42b7-b774-6c1813bbfe8c None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:34.782380 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 294/580] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 27 18:52:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:34.783085 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93212ddc-ce37-42b7-b774-6c1813bbfe8c None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:34.814412 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:34.830557 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:34.845996 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97100602-bbc5-4214-9731-d05d2b7a8f89 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:34.879164 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a411a45b-d4ca-4b3f-93a8-46f6d43c5264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:34.879805 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a411a45b-d4ca-4b3f-93a8-46f6d43c5264 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:34.880088 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a411a45b-d4ca-4b3f-93a8-46f6d43c5264 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:34.880363 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a411a45b-d4ca-4b3f-93a8-46f6d43c5264 None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:34.881054 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a411a45b-d4ca-4b3f-93a8-46f6d43c5264 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:34.881359 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a411a45b-d4ca-4b3f-93a8-46f6d43c5264 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:34.882709 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a411a45b-d4ca-4b3f-93a8-46f6d43c5264 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:34.885736 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93212ddc-ce37-42b7-b774-6c1813bbfe8c None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:34.894245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 287/581] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:52:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:34.895026 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a411a45b-d4ca-4b3f-93a8-46f6d43c5264 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:34.918696 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b45f011-397c-47ea-be8f-ddcd15329148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:34.919326 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45f011-397c-47ea-be8f-ddcd15329148 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:34.919608 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45f011-397c-47ea-be8f-ddcd15329148 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:34.919920 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45f011-397c-47ea-be8f-ddcd15329148 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:34.926817 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b45f011-397c-47ea-be8f-ddcd15329148 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:34.928299 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b45f011-397c-47ea-be8f-ddcd15329148 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:34.940101 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-3b45f011-397c-47ea-be8f-ddcd15329148 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 18:52:34.940101 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:34.940101 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:34.940101 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:34.940101 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:34.940101 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:34.940101 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:34.940101 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:34.940101 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:34.940101 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:34.940101 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:34.940101 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:34.940101 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:52:34.940101 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:52:34.940101 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:52:34.940101 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:52:34.941019 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:34.941019 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:34.941019 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:52:34.941019 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:52:34.941019 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:52:34.941019 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:52:34.941019 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:34.941019 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:34.941019 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:34.941019 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:34.941019 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:34.941019 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:34.941019 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:34.941019 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:34.941019 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:34.941019 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:34.941019 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:34.941019 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:34.941952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:34.941952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:34.941952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:52:34.941952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:52:34.941952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:52:34.941952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:52:34.941952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:52:34.941952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:52:34.941952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 18:52:34.941952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:34.941952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 295/582] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 27 18:52:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:34.941952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b45f011-397c-47ea-be8f-ddcd15329148 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:34.996303 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a411a45b-d4ca-4b3f-93a8-46f6d43c5264 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:35.028904 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336fb21a-2669-4942-a896-2c372abfc8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:35.029071 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:35.029515 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336fb21a-2669-4942-a896-2c372abfc8f0 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:35.029803 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336fb21a-2669-4942-a896-2c372abfc8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:35.030103 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336fb21a-2669-4942-a896-2c372abfc8f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:35.030806 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336fb21a-2669-4942-a896-2c372abfc8f0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:35.031139 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336fb21a-2669-4942-a896-2c372abfc8f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:35.032578 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336fb21a-2669-4942-a896-2c372abfc8f0 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:35.039116 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b45f011-397c-47ea-be8f-ddcd15329148 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:35.040797 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 288/583] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Jul 27 18:52:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:35.041554 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336fb21a-2669-4942-a896-2c372abfc8f0 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:35.051329 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:35.073240 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c608b-e57d-4e22-99e1-c3bc311ee2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:35.073906 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c608b-e57d-4e22-99e1-c3bc311ee2b3 None admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:35.074180 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c608b-e57d-4e22-99e1-c3bc311ee2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:35.074456 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c608b-e57d-4e22-99e1-c3bc311ee2b3 None admin] PATH_INFO: `/v3/projects/31f027c53398443eb548eaf3f24523e0/users/17fbef9db7734283aaad4962ee160171/roles/306da3282d854292a7a53b8642ee373b` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:35.088486 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4c608b-e57d-4e22-99e1-c3bc311ee2b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=31f027c53398443eb548eaf3f24523e0, user_id=17fbef9db7734283aaad4962ee160171, role_id=306da3282d854292a7a53b8642ee373b)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:35.089921 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4c608b-e57d-4e22-99e1-c3bc311ee2b3 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:35.102178 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 296/584] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 27 18:52:34 2022] PUT /identity/v3/projects/31f027c53398443eb548eaf3f24523e0/users/17fbef9db7734283aaad4962ee160171/roles/306da3282d854292a7a53b8642ee373b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:35.103466 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c608b-e57d-4e22-99e1-c3bc311ee2b3 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:35.150900 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336fb21a-2669-4942-a896-2c372abfc8f0 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:35.188069 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20603855-b9bf-48cb-ad26-91dfb4c79974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:35.188694 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20603855-b9bf-48cb-ad26-91dfb4c79974 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:35.188971 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20603855-b9bf-48cb-ad26-91dfb4c79974 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:35.189237 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20603855-b9bf-48cb-ad26-91dfb4c79974 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:35.190032 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20603855-b9bf-48cb-ad26-91dfb4c79974 None admin] RBAC: Adding query filter params (role.id=306da3282d854292a7a53b8642ee373b, scope.project.id=31f027c53398443eb548eaf3f24523e0, user.id=16a9f1909ab3458c8c131986e303831a) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:35.190338 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20603855-b9bf-48cb-ad26-91dfb4c79974 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:35.191791 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20603855-b9bf-48cb-ad26-91dfb4c79974 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:35.197862 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 289/585] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 27 18:52:35 2022] GET /identity/v3/role_assignments?user.id=16a9f1909ab3458c8c131986e303831a&scope.project.id=31f027c53398443eb548eaf3f24523e0&role.id=306da3282d854292a7a53b8642ee373b => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:35.198692 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20603855-b9bf-48cb-ad26-91dfb4c79974 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:35.244970 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c608b-e57d-4e22-99e1-c3bc311ee2b3 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:35.299839 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:35.303622 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba46f276-3ee4-4408-85a2-93e75557b70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:35.304357 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46f276-3ee4-4408-85a2-93e75557b70a None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:35.304636 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46f276-3ee4-4408-85a2-93e75557b70a None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:35.304905 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46f276-3ee4-4408-85a2-93e75557b70a None admin] PATH_INFO: `/v3/users/glance` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:35.317673 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba46f276-3ee4-4408-85a2-93e75557b70a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:35.319416 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba46f276-3ee4-4408-85a2-93e75557b70a None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:35.324135 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:35.341254 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-ba46f276-3ee4-4408-85a2-93e75557b70a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 27 18:52:35.341254 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:35.341254 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:35.341254 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:35.341254 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:35.341254 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:35.341254 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:35.341254 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:35.341254 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:35.341254 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:35.341254 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:35.341254 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:35.341254 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:52:35.341254 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:52:35.341254 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:52:35.341254 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:52:35.342455 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:35.342455 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:35.342455 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:52:35.342455 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:52:35.342455 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:52:35.342455 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:52:35.342455 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:35.342455 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:35.342455 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:35.342455 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:35.342455 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:35.342455 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:35.342455 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:35.342455 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:35.342455 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:35.342455 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:35.342455 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:35.342455 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:35.343554 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:35.343554 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:35.343554 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:52:35.343554 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:52:35.343554 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:52:35.343554 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:52:35.343554 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:52:35.343554 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:52:35.343554 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 27 18:52:35.343554 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:35.344259 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20603855-b9bf-48cb-ad26-91dfb4c79974 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:35.346301 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 297/586] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 27 18:52:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:35.347325 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba46f276-3ee4-4408-85a2-93e75557b70a None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:35.396152 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b49f4-fa22-4749-8c69-0159f13b6170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:35.396887 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b49f4-fa22-4749-8c69-0159f13b6170 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:35.397245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b49f4-fa22-4749-8c69-0159f13b6170 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:35.397591 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b49f4-fa22-4749-8c69-0159f13b6170 None admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:35.398461 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023b49f4-fa22-4749-8c69-0159f13b6170 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:35.399389 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023b49f4-fa22-4749-8c69-0159f13b6170 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:35.401549 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023b49f4-fa22-4749-8c69-0159f13b6170 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:35.427779 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 290/587] 10.222.0.20 () {56 vars in 1137 bytes} [Wed Jul 27 18:52:35 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:35.428722 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b49f4-fa22-4749-8c69-0159f13b6170 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:35.471232 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba46f276-3ee4-4408-85a2-93e75557b70a None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:35.506578 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a545fc4-6a3f-480d-b2e0-3f67b8dc8cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:35.507324 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a545fc4-6a3f-480d-b2e0-3f67b8dc8cb7 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:35.507679 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a545fc4-6a3f-480d-b2e0-3f67b8dc8cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:35.508046 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a545fc4-6a3f-480d-b2e0-3f67b8dc8cb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:35.520508 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a545fc4-6a3f-480d-b2e0-3f67b8dc8cb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:35.522051 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a545fc4-6a3f-480d-b2e0-3f67b8dc8cb7 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:35.538348 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-2a545fc4-6a3f-480d-b2e0-3f67b8dc8cb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:35.538348 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:35.538348 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:35.538348 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:35.538348 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:35.538348 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:35.538348 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:35.538348 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:35.538348 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:35.538348 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:35.538348 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:35.538348 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:35.538348 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:52:35.538348 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:52:35.538348 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:52:35.540666 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:52:35.540666 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:35.540666 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:35.540666 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:35.540666 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:35.540666 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:35.540666 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:35.540666 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:35.540666 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:35.540666 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:35.540666 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:35.540666 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:35.540666 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:35.540666 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:35.540666 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:35.540666 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:35.540666 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:35.542957 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:52:35.542957 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:52:35.542957 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:35.542957 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:35.542957 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 298/588] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:52:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:35.543591 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b49f4-fa22-4749-8c69-0159f13b6170 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:35.551880 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a545fc4-6a3f-480d-b2e0-3f67b8dc8cb7 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:35.580155 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:35.585358 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e76a508-a7b4-425b-93a8-daadc6e86529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:35.586039 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76a508-a7b4-425b-93a8-daadc6e86529 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:35.586374 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76a508-a7b4-425b-93a8-daadc6e86529 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:35.587226 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76a508-a7b4-425b-93a8-daadc6e86529 None admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:35.588184 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e76a508-a7b4-425b-93a8-daadc6e86529 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:35.588494 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e76a508-a7b4-425b-93a8-daadc6e86529 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:35.590077 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e76a508-a7b4-425b-93a8-daadc6e86529 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:35.598751 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:35.611454 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 291/589] 10.222.0.20 () {56 vars in 1137 bytes} [Wed Jul 27 18:52:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:35.612534 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e76a508-a7b4-425b-93a8-daadc6e86529 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:35.650949 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a545fc4-6a3f-480d-b2e0-3f67b8dc8cb7 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:35.687400 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc4105-0b39-456c-8b28-ac0effe862b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:35.688193 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc4105-0b39-456c-8b28-ac0effe862b1 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:35.688474 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc4105-0b39-456c-8b28-ac0effe862b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:35.688749 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc4105-0b39-456c-8b28-ac0effe862b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:35.700373 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc4105-0b39-456c-8b28-ac0effe862b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:35.701912 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc4105-0b39-456c-8b28-ac0effe862b1 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:35.722858 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-02fc4105-0b39-456c-8b28-ac0effe862b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:35.722858 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:35.722858 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:35.722858 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:35.722858 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:35.722858 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:35.722858 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:35.722858 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:35.722858 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:35.722858 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:35.722858 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:35.722858 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:35.722858 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:52:35.722858 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:52:35.722858 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:52:35.723987 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:52:35.723987 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:35.723987 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:35.723987 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:35.723987 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:35.723987 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:35.723987 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:35.723987 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:35.723987 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:35.723987 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:35.723987 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:35.723987 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:35.723987 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:35.723987 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:35.723987 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:35.723987 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:35.723987 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:35.725095 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:52:35.725095 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:52:35.725095 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:35.725095 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:35.725367 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e76a508-a7b4-425b-93a8-daadc6e86529 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:35.733358 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 299/590] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:52:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:35.734343 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc4105-0b39-456c-8b28-ac0effe862b1 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:35.770485 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f2591f-b51e-401f-b14f-f084b463d5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:35.771800 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2591f-b51e-401f-b14f-f084b463d5b1 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:35.772497 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2591f-b51e-401f-b14f-f084b463d5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:35.772921 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2591f-b51e-401f-b14f-f084b463d5b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:35.774949 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f2591f-b51e-401f-b14f-f084b463d5b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:35.775434 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f2591f-b51e-401f-b14f-f084b463d5b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:35.777224 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f2591f-b51e-401f-b14f-f084b463d5b1 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:35.797192 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 292/591] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:52:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:35.797192 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f2591f-b51e-401f-b14f-f084b463d5b1 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:35.846895 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:35.871233 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc4105-0b39-456c-8b28-ac0effe862b1 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:35.875120 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:35.910150 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f2591f-b51e-401f-b14f-f084b463d5b1 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:35.913629 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2533fc-f60a-44e9-9566-e7d6aa29d0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:35.914054 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2533fc-f60a-44e9-9566-e7d6aa29d0f3 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:35.914403 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2533fc-f60a-44e9-9566-e7d6aa29d0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:35.914786 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2533fc-f60a-44e9-9566-e7d6aa29d0f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:35.926707 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2533fc-f60a-44e9-9566-e7d6aa29d0f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:35.928420 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2533fc-f60a-44e9-9566-e7d6aa29d0f3 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:35.944060 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-be2533fc-f60a-44e9-9566-e7d6aa29d0f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:35.944060 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:35.944060 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:35.944060 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:35.944060 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:35.944060 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:35.944060 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:35.944060 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:35.944060 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:35.944060 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:35.944060 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:35.944060 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:35.944060 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:52:35.944060 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:52:35.944060 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:52:35.944968 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:52:35.944968 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:35.944968 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:35.944968 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:35.944968 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:35.944968 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:35.944968 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:35.944968 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:35.944968 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:35.944968 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:35.944968 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:35.944968 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:35.944968 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:35.944968 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:35.944968 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:35.944968 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:35.944968 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:35.945879 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:52:35.945879 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:52:35.945879 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:35.945879 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:35.945879 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 300/592] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:52:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:35.947455 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2533fc-f60a-44e9-9566-e7d6aa29d0f3 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:35.956600 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dfa4a6-46c5-4ba9-aa56-e59a50a6e08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:35.957462 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfa4a6-46c5-4ba9-aa56-e59a50a6e08e None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:35.957945 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfa4a6-46c5-4ba9-aa56-e59a50a6e08e None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:35.958409 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfa4a6-46c5-4ba9-aa56-e59a50a6e08e None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:35.959901 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dfa4a6-46c5-4ba9-aa56-e59a50a6e08e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:35.960394 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dfa4a6-46c5-4ba9-aa56-e59a50a6e08e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:35.963484 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dfa4a6-46c5-4ba9-aa56-e59a50a6e08e None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:35.986098 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 293/593] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:52:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:35.986098 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dfa4a6-46c5-4ba9-aa56-e59a50a6e08e None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:36.090704 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dfa4a6-46c5-4ba9-aa56-e59a50a6e08e None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:36.093874 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2533fc-f60a-44e9-9566-e7d6aa29d0f3 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:36.098523 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:36.128989 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d0dbf3-0443-4d9b-88c8-8e1e0fa18c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:36.129635 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0dbf3-0443-4d9b-88c8-8e1e0fa18c89 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:36.129926 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0dbf3-0443-4d9b-88c8-8e1e0fa18c89 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:36.130331 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0dbf3-0443-4d9b-88c8-8e1e0fa18c89 None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:36.131034 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d0dbf3-0443-4d9b-88c8-8e1e0fa18c89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:36.131650 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d0dbf3-0443-4d9b-88c8-8e1e0fa18c89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:36.133361 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d0dbf3-0443-4d9b-88c8-8e1e0fa18c89 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:36.140711 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1194e7-b711-443a-942e-57a90d0ebd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:36.142174 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1194e7-b711-443a-942e-57a90d0ebd99 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:36.142664 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1194e7-b711-443a-942e-57a90d0ebd99 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:36.143728 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1194e7-b711-443a-942e-57a90d0ebd99 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:36.146865 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 294/594] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:52:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:36.148256 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d0dbf3-0443-4d9b-88c8-8e1e0fa18c89 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:36.156444 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1194e7-b711-443a-942e-57a90d0ebd99 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:36.158655 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1194e7-b711-443a-942e-57a90d0ebd99 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:36.175147 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-da1194e7-b711-443a-942e-57a90d0ebd99 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 18:52:36.175147 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:36.175147 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:36.175147 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:36.175147 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:36.175147 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:36.175147 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:36.175147 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:36.175147 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:36.175147 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:36.175147 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:36.175147 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:36.175147 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:52:36.175147 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:52:36.175147 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:52:36.175147 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:52:36.176136 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:36.176136 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:36.176136 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:52:36.176136 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:52:36.176136 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:52:36.176136 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:52:36.176136 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:36.176136 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:36.176136 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:36.176136 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:36.176136 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:36.176136 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:36.176136 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:36.176136 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:36.176136 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:36.176136 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:36.176136 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:36.176136 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:36.177104 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:36.177104 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:36.177104 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:52:36.177104 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:52:36.177104 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:52:36.177104 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:52:36.177104 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:52:36.177104 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:52:36.177104 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 18:52:36.177104 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:36.184867 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 301/595] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 27 18:52:35 2022] GET /identity/v3/users/neutron => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:36.184867 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1194e7-b711-443a-942e-57a90d0ebd99 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:36.204382 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:36.286289 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d0dbf3-0443-4d9b-88c8-8e1e0fa18c89 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:36.299631 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1194e7-b711-443a-942e-57a90d0ebd99 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:36.333036 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baceec8f-5373-4edb-9358-8ac239e7f3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:36.334115 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baceec8f-5373-4edb-9358-8ac239e7f3aa None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:36.334777 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baceec8f-5373-4edb-9358-8ac239e7f3aa None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:36.335233 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baceec8f-5373-4edb-9358-8ac239e7f3aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:36.336320 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf95a894-dc30-4ff4-911a-44f9ac421cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:36.338091 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95a894-dc30-4ff4-911a-44f9ac421cf6 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:36.338257 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95a894-dc30-4ff4-911a-44f9ac421cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:36.338651 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95a894-dc30-4ff4-911a-44f9ac421cf6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:36.344961 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baceec8f-5373-4edb-9358-8ac239e7f3aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:36.346436 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf95a894-dc30-4ff4-911a-44f9ac421cf6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:36.347268 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baceec8f-5373-4edb-9358-8ac239e7f3aa None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:36.348069 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf95a894-dc30-4ff4-911a-44f9ac421cf6 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:36.361701 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-cf95a894-dc30-4ff4-911a-44f9ac421cf6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:52:36.361701 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:36.361701 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:36.361701 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:36.361701 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:36.361701 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:36.361701 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:36.361701 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:36.361701 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:36.361701 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:36.361701 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:36.361701 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:36.361701 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:52:36.361701 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:52:36.361701 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:52:36.362675 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:52:36.362675 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:36.362675 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:36.362675 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:36.362675 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:36.362675 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:36.362675 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:36.362675 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:36.362675 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:36.362675 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:36.362675 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:36.362675 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:36.362675 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:36.362675 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:36.362675 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:36.362675 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:36.362675 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:36.363577 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:52:36.363577 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:52:36.363577 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:52:36.363577 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:52:36.363577 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:52:36.363577 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:52:36.363577 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:52:36.363577 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:36.363577 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 302/596] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 27 18:52:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:36.364087 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf95a894-dc30-4ff4-911a-44f9ac421cf6 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:36.365054 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-baceec8f-5373-4edb-9358-8ac239e7f3aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:52:36.365054 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:36.365054 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:36.365054 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:36.365054 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:36.365054 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:36.365054 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:36.365054 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:36.365054 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:36.365054 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:36.365054 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:36.365054 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:36.365054 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:52:36.365054 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:52:36.365054 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:52:36.366054 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:52:36.366054 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:36.366054 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:36.366054 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:36.366054 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:36.366054 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:36.366054 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:36.366054 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:36.366054 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:36.366054 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:36.366054 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:36.366054 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:36.366054 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:36.366054 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:36.366054 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:36.366054 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:36.366054 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:36.367103 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:52:36.367103 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:52:36.367103 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:52:36.367103 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:52:36.367103 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:52:36.367103 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:52:36.367103 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:52:36.367103 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:36.375449 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 295/597] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 27 18:52:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:36.376549 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baceec8f-5373-4edb-9358-8ac239e7f3aa None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:36.416071 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:36.449210 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:36.474065 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf95a894-dc30-4ff4-911a-44f9ac421cf6 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:36.509589 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a668f-8c19-4870-bde7-5887c08d8ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:36.510321 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a668f-8c19-4870-bde7-5887c08d8ffd None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:36.510699 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a668f-8c19-4870-bde7-5887c08d8ffd None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:36.510957 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a668f-8c19-4870-bde7-5887c08d8ffd None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:36.511863 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2a668f-8c19-4870-bde7-5887c08d8ffd None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:36.512238 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2a668f-8c19-4870-bde7-5887c08d8ffd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:36.513334 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baceec8f-5373-4edb-9358-8ac239e7f3aa None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:36.513775 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2a668f-8c19-4870-bde7-5887c08d8ffd None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:36.535746 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 303/598] 10.222.0.20 () {56 vars in 1139 bytes} [Wed Jul 27 18:52:36 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:36.535746 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a668f-8c19-4870-bde7-5887c08d8ffd None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:36.560253 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd206b-0246-408c-81d7-33538329b17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:36.561075 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd206b-0246-408c-81d7-33538329b17b None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:36.561522 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd206b-0246-408c-81d7-33538329b17b None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:36.561945 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd206b-0246-408c-81d7-33538329b17b None admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:36.562831 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd206b-0246-408c-81d7-33538329b17b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:36.563295 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd206b-0246-408c-81d7-33538329b17b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:36.564889 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd206b-0246-408c-81d7-33538329b17b None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:36.578128 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 296/599] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 27 18:52:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:36.579250 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd206b-0246-408c-81d7-33538329b17b None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:36.669163 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a668f-8c19-4870-bde7-5887c08d8ffd None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:36.691076 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd206b-0246-408c-81d7-33538329b17b None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:36.704835 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab77a81-d810-47d0-b2a8-1d3bfe88de69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:36.705768 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab77a81-d810-47d0-b2a8-1d3bfe88de69 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:36.706248 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab77a81-d810-47d0-b2a8-1d3bfe88de69 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:36.706740 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab77a81-d810-47d0-b2a8-1d3bfe88de69 None admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:36.707721 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab77a81-d810-47d0-b2a8-1d3bfe88de69 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:36.708105 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:36.708430 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab77a81-d810-47d0-b2a8-1d3bfe88de69 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:36.710057 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab77a81-d810-47d0-b2a8-1d3bfe88de69 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:36.712511 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:36.725248 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 304/600] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 27 18:52:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:36.726792 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab77a81-d810-47d0-b2a8-1d3bfe88de69 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:36.736370 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d8ec06-12a5-4a08-9da7-238c05851009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:36.737643 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8ec06-12a5-4a08-9da7-238c05851009 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:36.738148 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8ec06-12a5-4a08-9da7-238c05851009 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:36.738633 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8ec06-12a5-4a08-9da7-238c05851009 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:36.751495 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d8ec06-12a5-4a08-9da7-238c05851009 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:36.753848 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d8ec06-12a5-4a08-9da7-238c05851009 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:36.773077 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-02d8ec06-12a5-4a08-9da7-238c05851009 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:36.773077 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:36.773077 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:36.773077 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:36.773077 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:36.773077 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:36.773077 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:36.773077 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:36.773077 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:36.773077 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:36.773077 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:36.773077 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:36.773077 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:52:36.773077 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:52:36.773077 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:52:36.774078 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:52:36.774078 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:36.774078 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:36.774078 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:36.774078 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:36.774078 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:36.774078 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:36.774078 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:36.774078 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:36.774078 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:36.774078 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:36.774078 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:36.774078 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:36.774078 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:36.774078 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:36.774078 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:36.774078 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:36.775449 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:52:36.775449 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:52:36.775449 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:36.775449 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:36.780010 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 297/601] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:52:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:36.781281 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d8ec06-12a5-4a08-9da7-238c05851009 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:36.860251 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab77a81-d810-47d0-b2a8-1d3bfe88de69 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:36.898269 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b6f68-fccb-4f86-8f15-4b586b2b57d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:36.899482 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d8ec06-12a5-4a08-9da7-238c05851009 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:36.900042 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b6f68-fccb-4f86-8f15-4b586b2b57d2 None admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:36.900523 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b6f68-fccb-4f86-8f15-4b586b2b57d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:36.901080 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b6f68-fccb-4f86-8f15-4b586b2b57d2 None admin] PATH_INFO: `/v3/projects/31f027c53398443eb548eaf3f24523e0/users/6c4b9109e80b4ae19a7c31de1cd9d2b9/roles/306da3282d854292a7a53b8642ee373b` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:36.916909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b6f68-fccb-4f86-8f15-4b586b2b57d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=31f027c53398443eb548eaf3f24523e0, user_id=6c4b9109e80b4ae19a7c31de1cd9d2b9, role_id=306da3282d854292a7a53b8642ee373b)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:36.918792 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b6f68-fccb-4f86-8f15-4b586b2b57d2 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:36.933383 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 305/602] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 27 18:52:36 2022] PUT /identity/v3/projects/31f027c53398443eb548eaf3f24523e0/users/6c4b9109e80b4ae19a7c31de1cd9d2b9/roles/306da3282d854292a7a53b8642ee373b => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:36.934620 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b6f68-fccb-4f86-8f15-4b586b2b57d2 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:36.936978 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e87ba27-c44f-466d-a95c-86a0e0328f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:36.938102 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87ba27-c44f-466d-a95c-86a0e0328f92 None admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:36.938530 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87ba27-c44f-466d-a95c-86a0e0328f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:36.938909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87ba27-c44f-466d-a95c-86a0e0328f92 None admin] PATH_INFO: `/v3/projects/31f027c53398443eb548eaf3f24523e0/users/d5525865e12c41fe8da761cd25c14e2e/roles/306da3282d854292a7a53b8642ee373b` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:36.950883 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:36.958467 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e87ba27-c44f-466d-a95c-86a0e0328f92 None admin] RBAC: Authorizing `identity:create_grant(project_id=31f027c53398443eb548eaf3f24523e0, user_id=d5525865e12c41fe8da761cd25c14e2e, role_id=306da3282d854292a7a53b8642ee373b)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:36.960390 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e87ba27-c44f-466d-a95c-86a0e0328f92 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:36.978967 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 298/603] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 27 18:52:36 2022] PUT /identity/v3/projects/31f027c53398443eb548eaf3f24523e0/users/d5525865e12c41fe8da761cd25c14e2e/roles/306da3282d854292a7a53b8642ee373b => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:37.019161 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:37.104044 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b6f68-fccb-4f86-8f15-4b586b2b57d2 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:37.156973 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7a66c-8221-408e-b6d3-90d017ce22ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:37.157609 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7a66c-8221-408e-b6d3-90d017ce22ad None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:37.157890 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7a66c-8221-408e-b6d3-90d017ce22ad None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:37.158168 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7a66c-8221-408e-b6d3-90d017ce22ad None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:37.158877 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7a66c-8221-408e-b6d3-90d017ce22ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:37.159185 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7a66c-8221-408e-b6d3-90d017ce22ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:37.160599 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7a66c-8221-408e-b6d3-90d017ce22ad None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:37.193495 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 306/604] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:52:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:37.195542 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d71b60a-dcb7-4609-b356-6142b7545574 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:37.195915 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d71b60a-dcb7-4609-b356-6142b7545574 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:37.196739 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d71b60a-dcb7-4609-b356-6142b7545574 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:37.198234 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 299/605] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:52:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:52:37.203616 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d71b60a-dcb7-4609-b356-6142b7545574 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:37.203994 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e7edd-2fd9-4ed5-8db1-d9bc16863cde None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:37.204347 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e7edd-2fd9-4ed5-8db1-d9bc16863cde None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:37.204629 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e7edd-2fd9-4ed5-8db1-d9bc16863cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:37.225253 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-f63e7edd-2fd9-4ed5-8db1-d9bc16863cde None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:37.226787 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-f63e7edd-2fd9-4ed5-8db1-d9bc16863cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:37.315854 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 307/606] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:52:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:52:37.320681 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48950d-eeff-404c-affd-8910aa28ab6b None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:37.321212 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48950d-eeff-404c-affd-8910aa28ab6b None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:37.321670 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48950d-eeff-404c-affd-8910aa28ab6b None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:37.323171 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 308/607] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:52:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:52:37.329452 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f595a-84bd-4d92-932d-306c29947b51 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:37.329990 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f595a-84bd-4d92-932d-306c29947b51 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:37.330339 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f595a-84bd-4d92-932d-306c29947b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:37.341068 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d71b60a-dcb7-4609-b356-6142b7545574 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:37.350933 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-de8f595a-84bd-4d92-932d-306c29947b51 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:37.353057 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-de8f595a-84bd-4d92-932d-306c29947b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:37.387808 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:37.387998 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ad202-3020-4e83-94f2-89149373b367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:37.388534 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ad202-3020-4e83-94f2-89149373b367 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:37.388835 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ad202-3020-4e83-94f2-89149373b367 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:37.389126 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ad202-3020-4e83-94f2-89149373b367 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:37.397057 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ad202-3020-4e83-94f2-89149373b367 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:37.398576 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ad202-3020-4e83-94f2-89149373b367 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:37.411301 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-527ad202-3020-4e83-94f2-89149373b367 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:52:37.411301 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:37.411301 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:37.411301 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:37.411301 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:37.411301 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:37.411301 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:37.411301 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:37.411301 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:37.411301 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:37.411301 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:37.411301 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:37.411301 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:52:37.411301 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:52:37.411301 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:52:37.412272 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:52:37.412272 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:37.412272 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:37.412272 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:37.412272 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:37.412272 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:37.412272 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:37.412272 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:37.412272 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:37.412272 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:37.412272 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:37.412272 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:37.412272 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:37.412272 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:37.412272 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:37.412272 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:37.412272 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:37.413170 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:52:37.413170 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:52:37.413170 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:52:37.413170 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:52:37.413170 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:52:37.413170 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:52:37.413170 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:52:37.413170 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:37.413170 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 300/608] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 27 18:52:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:52:37.413649 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ad202-3020-4e83-94f2-89149373b367 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:37.451231 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 309/609] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:52:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:52:37.452993 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8f595a-84bd-4d92-932d-306c29947b51 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:37.471601 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:37.530938 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ad202-3020-4e83-94f2-89149373b367 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:37.567262 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ff284-3003-412a-8d32-48ae6f1c243f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:37.567935 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ff284-3003-412a-8d32-48ae6f1c243f None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:37.568215 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ff284-3003-412a-8d32-48ae6f1c243f None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:37.568485 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ff284-3003-412a-8d32-48ae6f1c243f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:37.573821 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8f595a-84bd-4d92-932d-306c29947b51 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:37.580134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1ff284-3003-412a-8d32-48ae6f1c243f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:52:37.585134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-ac1ff284-3003-412a-8d32-48ae6f1c243f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:52:37.585134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:37.585134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:37.585134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:37.585134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:37.585134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:37.585134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:37.585134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:37.585134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:37.585134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:37.585134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:37.585134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:37.585134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:52:37.585134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:52:37.585134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:52:37.585134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:52:37.586350 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:52:37.586350 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:52:37.586350 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:52:37.586350 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:52:37.586350 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:37.586350 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:37.586350 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:37.586350 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:37.586350 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:37.586350 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:37.586350 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:37.586350 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:37.586350 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:37.586350 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:37.586350 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:37.586350 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:37.587407 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:37.587407 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:37.587407 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:37.587407 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:37.587407 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:52:37.587407 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:52:37.587407 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:52:37.587407 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:52:37.587407 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:52:37.587407 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:52:37.587407 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:52:37.587407 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:37.587407 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 301/610] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 27 18:52:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:37.587407 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ff284-3003-412a-8d32-48ae6f1c243f None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:37.621877 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05864ee7-f5bc-46e7-b680-3e9755ac3638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:37.623277 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05864ee7-f5bc-46e7-b680-3e9755ac3638 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:37.624351 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05864ee7-f5bc-46e7-b680-3e9755ac3638 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:37.624819 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05864ee7-f5bc-46e7-b680-3e9755ac3638 None admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:37.626331 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05864ee7-f5bc-46e7-b680-3e9755ac3638 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:37.626649 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05864ee7-f5bc-46e7-b680-3e9755ac3638 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:37.628572 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05864ee7-f5bc-46e7-b680-3e9755ac3638 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:37.647844 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 310/611] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 27 18:52:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:37.648981 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05864ee7-f5bc-46e7-b680-3e9755ac3638 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:37.675902 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:37.714584 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ff284-3003-412a-8d32-48ae6f1c243f None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:37.725083 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:37.752040 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076f64fd-82b4-4a76-b15e-e9c4fed3a07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:37.752723 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f64fd-82b4-4a76-b15e-e9c4fed3a07f None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:37.753008 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f64fd-82b4-4a76-b15e-e9c4fed3a07f None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:37.753277 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f64fd-82b4-4a76-b15e-e9c4fed3a07f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:37.757283 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05864ee7-f5bc-46e7-b680-3e9755ac3638 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:37.764073 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076f64fd-82b4-4a76-b15e-e9c4fed3a07f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:52:37.769822 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-076f64fd-82b4-4a76-b15e-e9c4fed3a07f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:52:37.769822 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:37.769822 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:37.769822 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:37.769822 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:37.769822 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:37.769822 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:37.769822 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:37.769822 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:37.769822 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:37.769822 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:37.769822 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:37.769822 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:52:37.769822 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:52:37.769822 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:52:37.769822 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:52:37.770741 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:52:37.770741 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:52:37.770741 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:52:37.770741 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:52:37.770741 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:37.770741 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:37.770741 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:37.770741 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:37.770741 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:37.770741 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:37.770741 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:37.770741 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:37.770741 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:37.770741 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:37.770741 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:37.770741 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:37.771590 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:37.771590 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:37.771590 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:37.771590 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:37.771590 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:52:37.771590 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:52:37.771590 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:52:37.771590 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:52:37.771590 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:52:37.771590 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:52:37.771590 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:52:37.771590 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:37.771590 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 302/612] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 27 18:52:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:37.772310 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076f64fd-82b4-4a76-b15e-e9c4fed3a07f None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:37.800837 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be754a8-c330-4e3a-a5aa-e5c28de931da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:37.801454 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be754a8-c330-4e3a-a5aa-e5c28de931da None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:37.801738 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be754a8-c330-4e3a-a5aa-e5c28de931da None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:37.802012 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be754a8-c330-4e3a-a5aa-e5c28de931da None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:37.802721 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be754a8-c330-4e3a-a5aa-e5c28de931da None admin] RBAC: Adding query filter params (name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:37.803024 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be754a8-c330-4e3a-a5aa-e5c28de931da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:37.804407 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be754a8-c330-4e3a-a5aa-e5c28de931da None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:37.817858 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 311/613] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Jul 27 18:52:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:37.818713 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be754a8-c330-4e3a-a5aa-e5c28de931da None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:37.877810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076f64fd-82b4-4a76-b15e-e9c4fed3a07f None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:37.913440 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:37.920318 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb8d79-1216-4b22-8fdf-568aaf18879c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:37.921361 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb8d79-1216-4b22-8fdf-568aaf18879c None admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:37.921787 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb8d79-1216-4b22-8fdf-568aaf18879c None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:37.922182 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb8d79-1216-4b22-8fdf-568aaf18879c None admin] PATH_INFO: `/v3/projects/31f027c53398443eb548eaf3f24523e0/users/703f0431d017405d942539de93a565b7/roles/306da3282d854292a7a53b8642ee373b` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:37.929707 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be754a8-c330-4e3a-a5aa-e5c28de931da None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:37.941068 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcb8d79-1216-4b22-8fdf-568aaf18879c None admin] RBAC: Authorizing `identity:create_grant(project_id=31f027c53398443eb548eaf3f24523e0, user_id=703f0431d017405d942539de93a565b7, role_id=306da3282d854292a7a53b8642ee373b)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:37.942776 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcb8d79-1216-4b22-8fdf-568aaf18879c None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:37.967878 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 303/614] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 27 18:52:37 2022] PUT /identity/v3/projects/31f027c53398443eb548eaf3f24523e0/users/703f0431d017405d942539de93a565b7/roles/306da3282d854292a7a53b8642ee373b => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:37.970087 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb8d79-1216-4b22-8fdf-568aaf18879c None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:37.976437 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce1fd4f-9dd7-49c5-8567-b4054294c3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:37.978727 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1fd4f-9dd7-49c5-8567-b4054294c3bd None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:37.979075 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1fd4f-9dd7-49c5-8567-b4054294c3bd None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:37.979352 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1fd4f-9dd7-49c5-8567-b4054294c3bd None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:37.982956 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce1fd4f-9dd7-49c5-8567-b4054294c3bd None admin] RBAC: Adding query filter params (name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:37.983314 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce1fd4f-9dd7-49c5-8567-b4054294c3bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:37.984814 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce1fd4f-9dd7-49c5-8567-b4054294c3bd None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:38.010905 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 312/615] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Jul 27 18:52:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:38.012160 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:38.013402 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce1fd4f-9dd7-49c5-8567-b4054294c3bd None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:38.171644 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb8d79-1216-4b22-8fdf-568aaf18879c None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:38.189123 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce1fd4f-9dd7-49c5-8567-b4054294c3bd None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:38.226931 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f893f6f7-0624-4809-a195-ac644f28d5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:38.228060 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893f6f7-0624-4809-a195-ac644f28d5c1 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:38.228336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893f6f7-0624-4809-a195-ac644f28d5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:38.228595 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f0b5e-8bd8-4a67-91d5-0433450958df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:38.228714 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893f6f7-0624-4809-a195-ac644f28d5c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:38.229429 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f0b5e-8bd8-4a67-91d5-0433450958df None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:38.229715 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f0b5e-8bd8-4a67-91d5-0433450958df None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:38.229990 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f0b5e-8bd8-4a67-91d5-0433450958df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:38.240594 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f893f6f7-0624-4809-a195-ac644f28d5c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:38.241907 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547f0b5e-8bd8-4a67-91d5-0433450958df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:38.242041 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f893f6f7-0624-4809-a195-ac644f28d5c1 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:38.244218 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547f0b5e-8bd8-4a67-91d5-0433450958df None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:38.253663 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:38.260589 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-547f0b5e-8bd8-4a67-91d5-0433450958df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:38.260589 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:38.260589 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:38.260589 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:38.260589 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:38.260589 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:38.260589 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:38.260589 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:38.260589 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:38.260589 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:38.260589 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:38.260589 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:38.260589 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:52:38.260589 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:52:38.260589 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:52:38.261483 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:52:38.261483 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:38.261483 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:38.261483 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:38.261483 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:38.261483 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:38.261483 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:38.261483 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:38.261483 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:38.261483 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:38.261483 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:38.261483 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:38.261483 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:38.261483 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:38.261483 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:38.261483 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:38.261483 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:38.262379 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:52:38.262379 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:52:38.262379 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:38.262379 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:38.262594 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-f893f6f7-0624-4809-a195-ac644f28d5c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:38.262594 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:38.262594 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:38.262594 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:38.262594 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:38.262594 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:38.262594 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:38.262594 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:38.262594 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:38.262594 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:38.262594 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:38.262594 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:38.262594 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:52:38.262594 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:52:38.262594 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:52:38.263561 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:52:38.263561 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:38.263561 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:38.263561 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:38.263561 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:38.263561 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:38.263561 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:38.263561 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:38.263561 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:38.263561 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:38.263561 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:38.263561 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:38.263561 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:38.263561 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:38.263561 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:38.263561 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:38.263561 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:38.264678 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:52:38.264678 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:52:38.264678 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:38.264678 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:38.264956 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 313/616] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:52:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:38.266536 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 304/617] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:52:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:38.271874 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f893f6f7-0624-4809-a195-ac644f28d5c1 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:38.272004 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f0b5e-8bd8-4a67-91d5-0433450958df None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:38.382830 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f0b5e-8bd8-4a67-91d5-0433450958df None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:38.429025 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b731d3dd-7dc3-4bff-ba56-303eba950ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:38.429644 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731d3dd-7dc3-4bff-ba56-303eba950ce8 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:38.429923 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731d3dd-7dc3-4bff-ba56-303eba950ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:38.430230 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731d3dd-7dc3-4bff-ba56-303eba950ce8 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:38.430925 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b731d3dd-7dc3-4bff-ba56-303eba950ce8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:38.431228 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b731d3dd-7dc3-4bff-ba56-303eba950ce8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:38.432611 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b731d3dd-7dc3-4bff-ba56-303eba950ce8 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:38.447915 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:38.459836 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 314/618] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:52:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:38.465495 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b731d3dd-7dc3-4bff-ba56-303eba950ce8 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:38.502590 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f893f6f7-0624-4809-a195-ac644f28d5c1 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:38.570960 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11dad6a-62a7-4376-a73c-7ef9ea066f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:38.571454 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:38.572749 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11dad6a-62a7-4376-a73c-7ef9ea066f39 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:38.573025 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11dad6a-62a7-4376-a73c-7ef9ea066f39 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:38.573290 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11dad6a-62a7-4376-a73c-7ef9ea066f39 None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:38.573981 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11dad6a-62a7-4376-a73c-7ef9ea066f39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:38.574440 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11dad6a-62a7-4376-a73c-7ef9ea066f39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:38.576452 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11dad6a-62a7-4376-a73c-7ef9ea066f39 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:38.596395 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 305/619] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:52:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:38.601485 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11dad6a-62a7-4376-a73c-7ef9ea066f39 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:38.623009 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b731d3dd-7dc3-4bff-ba56-303eba950ce8 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:38.707668 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d584c-ef1c-485a-9af5-f0ba121ea107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:38.708332 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d584c-ef1c-485a-9af5-f0ba121ea107 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:38.708604 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d584c-ef1c-485a-9af5-f0ba121ea107 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:38.708869 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d584c-ef1c-485a-9af5-f0ba121ea107 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:38.721453 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d584c-ef1c-485a-9af5-f0ba121ea107 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:38.722883 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d584c-ef1c-485a-9af5-f0ba121ea107 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:38.746561 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-ee9d584c-ef1c-485a-9af5-f0ba121ea107 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 18:52:38.746561 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:38.746561 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:38.746561 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:38.746561 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:38.746561 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:38.746561 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:38.746561 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:38.746561 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:38.746561 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:38.746561 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:38.746561 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:38.746561 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:52:38.746561 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:52:38.746561 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:52:38.746561 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:52:38.747956 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:38.747956 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:38.747956 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:52:38.747956 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:52:38.747956 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:52:38.747956 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:52:38.747956 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:38.747956 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:38.747956 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:38.747956 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:38.747956 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:38.747956 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:38.747956 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:38.747956 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:38.747956 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:38.747956 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:38.747956 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:38.747956 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:38.749150 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:38.749150 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:38.749150 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:52:38.749150 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:52:38.749150 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:52:38.749150 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:52:38.749150 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:52:38.749150 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:52:38.749150 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 18:52:38.749150 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:38.753729 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 315/620] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 27 18:52:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:52:38.757545 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d584c-ef1c-485a-9af5-f0ba121ea107 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:38.759717 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11dad6a-62a7-4376-a73c-7ef9ea066f39 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:38.824133 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:38.835452 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c851b9-af75-4327-89ca-ddf41ea381a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:38.836119 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c851b9-af75-4327-89ca-ddf41ea381a6 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:38.836426 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c851b9-af75-4327-89ca-ddf41ea381a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:38.836699 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c851b9-af75-4327-89ca-ddf41ea381a6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:38.847628 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c851b9-af75-4327-89ca-ddf41ea381a6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:38.851012 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c851b9-af75-4327-89ca-ddf41ea381a6 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:38.872303 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-23c851b9-af75-4327-89ca-ddf41ea381a6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 18:52:38.872303 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:38.872303 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:38.872303 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:38.872303 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:38.872303 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:38.872303 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:38.872303 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:38.872303 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:38.872303 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:38.872303 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:38.872303 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:38.872303 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:52:38.872303 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:52:38.872303 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:52:38.872303 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:52:38.873317 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:38.873317 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:38.873317 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:52:38.873317 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:52:38.873317 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:52:38.873317 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:52:38.873317 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:38.873317 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:38.873317 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:38.873317 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:38.873317 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:38.873317 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:38.873317 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:38.873317 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:38.873317 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:38.873317 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:38.873317 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:38.873317 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:38.874270 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:38.874270 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:38.874270 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:52:38.874270 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:52:38.874270 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:52:38.874270 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:52:38.874270 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:52:38.874270 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:52:38.874270 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 18:52:38.874270 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:38.874270 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 306/621] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Jul 27 18:52:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:52:38.879224 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c851b9-af75-4327-89ca-ddf41ea381a6 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:38.928527 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d584c-ef1c-485a-9af5-f0ba121ea107 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:38.968364 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:39.000150 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a1fe50-acaf-445c-8145-4e36b8cbfaac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:39.000768 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1fe50-acaf-445c-8145-4e36b8cbfaac None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:39.001042 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1fe50-acaf-445c-8145-4e36b8cbfaac None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:39.001316 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1fe50-acaf-445c-8145-4e36b8cbfaac None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:39.002104 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a1fe50-acaf-445c-8145-4e36b8cbfaac None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:39.002404 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a1fe50-acaf-445c-8145-4e36b8cbfaac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:39.005410 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a1fe50-acaf-445c-8145-4e36b8cbfaac None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:39.037241 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 316/622] 10.222.0.20 () {56 vars in 1135 bytes} [Wed Jul 27 18:52:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:39.042219 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c851b9-af75-4327-89ca-ddf41ea381a6 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:39.043609 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a1fe50-acaf-445c-8145-4e36b8cbfaac None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:39.143565 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c8632-be92-4f46-b032-b1c6e9ef2a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:39.144211 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c8632-be92-4f46-b032-b1c6e9ef2a0d None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:39.144494 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c8632-be92-4f46-b032-b1c6e9ef2a0d None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:39.144766 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c8632-be92-4f46-b032-b1c6e9ef2a0d None admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:39.145561 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89c8632-be92-4f46-b032-b1c6e9ef2a0d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:39.145868 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89c8632-be92-4f46-b032-b1c6e9ef2a0d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:39.147285 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89c8632-be92-4f46-b032-b1c6e9ef2a0d None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:39.151102 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a1fe50-acaf-445c-8145-4e36b8cbfaac None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:39.174779 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 307/623] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Jul 27 18:52:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:39.180911 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c8632-be92-4f46-b032-b1c6e9ef2a0d None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:39.211267 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b063c-36a0-4812-828b-35faf57b795f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:39.213379 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b063c-36a0-4812-828b-35faf57b795f None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:39.213656 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b063c-36a0-4812-828b-35faf57b795f None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:39.213928 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b063c-36a0-4812-828b-35faf57b795f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:39.236011 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4b063c-36a0-4812-828b-35faf57b795f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:39.240562 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4b063c-36a0-4812-828b-35faf57b795f None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:39.267610 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-3a4b063c-36a0-4812-828b-35faf57b795f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:39.267610 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:39.267610 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:39.267610 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:39.267610 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:39.267610 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:39.267610 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:39.267610 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:39.267610 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:39.267610 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:39.267610 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:39.267610 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:39.267610 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:52:39.267610 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:52:39.267610 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:52:39.268603 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:52:39.268603 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:39.268603 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:39.268603 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:39.268603 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:39.268603 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:39.268603 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:39.268603 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:39.268603 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:39.268603 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:39.268603 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:39.268603 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:39.268603 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:39.268603 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:39.268603 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:39.268603 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:39.268603 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:39.269545 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:52:39.269545 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:52:39.269545 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:39.269545 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:39.277544 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 317/624] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:52:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:39.278104 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:39.278413 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b063c-36a0-4812-828b-35faf57b795f None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:39.344106 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:39.387533 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c8632-be92-4f46-b032-b1c6e9ef2a0d None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:39.424991 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70d10b-8c72-40bd-b52d-14a179769640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:39.426013 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70d10b-8c72-40bd-b52d-14a179769640 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:39.426775 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70d10b-8c72-40bd-b52d-14a179769640 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:39.427055 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70d10b-8c72-40bd-b52d-14a179769640 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:39.438510 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b063c-36a0-4812-828b-35faf57b795f None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:39.475501 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fbf919-f3ee-4cd2-8cac-120c294a9761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:39.476131 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fbf919-f3ee-4cd2-8cac-120c294a9761 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:39.476518 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fbf919-f3ee-4cd2-8cac-120c294a9761 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:39.476788 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fbf919-f3ee-4cd2-8cac-120c294a9761 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:39.477627 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fbf919-f3ee-4cd2-8cac-120c294a9761 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:39.477929 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fbf919-f3ee-4cd2-8cac-120c294a9761 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:39.479344 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fbf919-f3ee-4cd2-8cac-120c294a9761 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:39.492131 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 318/625] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:52:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:39.493370 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacca6b3-a056-43d4-bb3e-48f3113d9b2a None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:39.493658 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacca6b3-a056-43d4-bb3e-48f3113d9b2a None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:39.493930 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacca6b3-a056-43d4-bb3e-48f3113d9b2a None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:39.499160 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 319/626] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:52:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:52:39.499160 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009bb52c-0284-48a6-b9bc-48762b38fd2b None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:39.499160 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009bb52c-0284-48a6-b9bc-48762b38fd2b None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:39.499160 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009bb52c-0284-48a6-b9bc-48762b38fd2b None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:39.499160 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 320/627] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:52:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:52:39.499551 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009bb52c-0284-48a6-b9bc-48762b38fd2b None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:39.506050 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae70d10b-8c72-40bd-b52d-14a179769640 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:39.507532 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae70d10b-8c72-40bd-b52d-14a179769640 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:39.565392 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:39.609638 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:39.621144 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009bb52c-0284-48a6-b9bc-48762b38fd2b None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:39.623700 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 308/628] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 27 18:52:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 18:52:39.625023 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e994f-873e-45b7-bf2d-9eb9698e0eb8 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:39.625316 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e994f-873e-45b7-bf2d-9eb9698e0eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:39.625594 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e994f-873e-45b7-bf2d-9eb9698e0eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:39.643826 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-953e994f-873e-45b7-bf2d-9eb9698e0eb8 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:39.645009 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-953e994f-873e-45b7-bf2d-9eb9698e0eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:39.660636 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2515c4-5605-4282-a902-2f67ae2e9552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:39.661271 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2515c4-5605-4282-a902-2f67ae2e9552 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:39.661555 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2515c4-5605-4282-a902-2f67ae2e9552 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:39.661825 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2515c4-5605-4282-a902-2f67ae2e9552 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:39.669295 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2515c4-5605-4282-a902-2f67ae2e9552 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:39.670714 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2515c4-5605-4282-a902-2f67ae2e9552 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:39.682003 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-5d2515c4-5605-4282-a902-2f67ae2e9552 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:52:39.682003 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:39.682003 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:39.682003 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:39.682003 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:39.682003 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:39.682003 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:39.682003 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:39.682003 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:39.682003 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:39.682003 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:39.682003 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:39.682003 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:52:39.682003 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:52:39.682003 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:52:39.683032 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:52:39.683032 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:39.683032 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:39.683032 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:39.683032 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:39.683032 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:39.683032 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:39.683032 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:39.683032 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:39.683032 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:39.683032 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:39.683032 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:39.683032 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:39.683032 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:39.683032 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:39.683032 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:39.683032 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:39.684347 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:52:39.684347 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:52:39.684347 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:52:39.684347 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:52:39.684347 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:52:39.684347 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:52:39.684347 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:52:39.684347 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:39.687862 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 321/629] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 27 18:52:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:39.689110 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e328598-c22c-4ddf-89a3-4c4c73ad867a None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:39.689395 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e328598-c22c-4ddf-89a3-4c4c73ad867a None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:39.689670 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e328598-c22c-4ddf-89a3-4c4c73ad867a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:39.707189 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-3e328598-c22c-4ddf-89a3-4c4c73ad867a None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:39.708418 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-3e328598-c22c-4ddf-89a3-4c4c73ad867a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:39.721705 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 309/630] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:52:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:52:39.722863 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953e994f-873e-45b7-bf2d-9eb9698e0eb8 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:39.791877 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 322/631] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:52:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:52:39.792949 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e328598-c22c-4ddf-89a3-4c4c73ad867a None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:39.823233 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:39.849619 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953e994f-873e-45b7-bf2d-9eb9698e0eb8 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:39.883309 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:39.896314 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad1a366-61f2-4158-8195-394e7f85e8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:39.896961 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1a366-61f2-4158-8195-394e7f85e8ed None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:39.897243 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1a366-61f2-4158-8195-394e7f85e8ed None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:39.897515 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1a366-61f2-4158-8195-394e7f85e8ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:39.904504 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e328598-c22c-4ddf-89a3-4c4c73ad867a None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:39.909316 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad1a366-61f2-4158-8195-394e7f85e8ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:39.910778 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad1a366-61f2-4158-8195-394e7f85e8ed None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:39.926306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-fad1a366-61f2-4158-8195-394e7f85e8ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:39.926306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:39.926306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:39.926306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:39.926306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:39.926306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:39.926306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:39.926306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:39.926306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:39.926306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:39.926306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:39.926306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:39.926306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:52:39.926306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:52:39.926306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:52:39.927247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:52:39.927247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:39.927247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:39.927247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:39.927247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:39.927247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:39.927247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:39.927247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:39.927247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:39.927247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:39.927247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:39.927247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:39.927247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:39.927247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:39.927247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:39.927247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:39.927247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:39.928411 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:52:39.928411 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:52:39.928411 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:39.928411 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:39.928411 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 310/632] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:52:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:39.928411 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad1a366-61f2-4158-8195-394e7f85e8ed None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:39.946220 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd0eee1-90e4-4faa-8425-8efc26ef124f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:39.947526 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0eee1-90e4-4faa-8425-8efc26ef124f None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:39.948023 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0eee1-90e4-4faa-8425-8efc26ef124f None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:39.948374 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0eee1-90e4-4faa-8425-8efc26ef124f None admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:39.949184 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd0eee1-90e4-4faa-8425-8efc26ef124f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:39.949549 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd0eee1-90e4-4faa-8425-8efc26ef124f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:39.951032 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd0eee1-90e4-4faa-8425-8efc26ef124f None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:39.967977 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 323/633] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 27 18:52:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:39.968676 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd0eee1-90e4-4faa-8425-8efc26ef124f None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:40.032118 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad1a366-61f2-4158-8195-394e7f85e8ed None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:40.061127 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:40.068712 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28959e0c-eeef-44d4-8abe-68f0dd9fd3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:40.069349 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28959e0c-eeef-44d4-8abe-68f0dd9fd3ac None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:40.069633 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28959e0c-eeef-44d4-8abe-68f0dd9fd3ac None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:40.069913 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28959e0c-eeef-44d4-8abe-68f0dd9fd3ac None admin] PATH_INFO: `/v3/roles/service` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:40.074677 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd0eee1-90e4-4faa-8425-8efc26ef124f None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:40.081000 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28959e0c-eeef-44d4-8abe-68f0dd9fd3ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:52:40.086826 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-28959e0c-eeef-44d4-8abe-68f0dd9fd3ac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:52:40.086826 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:40.086826 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:40.086826 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:40.086826 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:40.086826 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:40.086826 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:40.086826 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:40.086826 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:40.086826 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:40.086826 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:40.086826 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:40.086826 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:52:40.086826 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:52:40.086826 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:52:40.086826 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:52:40.088021 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:52:40.088021 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:52:40.088021 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:52:40.088021 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:52:40.088021 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:40.088021 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:40.088021 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:40.088021 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:40.088021 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:40.088021 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:40.088021 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:40.088021 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:40.088021 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:40.088021 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:40.088021 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:40.088021 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:40.088847 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:40.088847 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:40.088847 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:40.088847 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:40.088847 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:52:40.088847 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:52:40.088847 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:52:40.088847 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:52:40.088847 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:52:40.088847 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:52:40.088847 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:52:40.088847 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:40.088847 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 311/634] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 27 18:52:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:40.088847 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28959e0c-eeef-44d4-8abe-68f0dd9fd3ac None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:40.115532 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1adafb-f9e1-411d-b8d5-90660581a1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:40.116350 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1adafb-f9e1-411d-b8d5-90660581a1b3 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:40.116686 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1adafb-f9e1-411d-b8d5-90660581a1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:40.117019 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1adafb-f9e1-411d-b8d5-90660581a1b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:40.125985 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:40.130188 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1adafb-f9e1-411d-b8d5-90660581a1b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:52:40.135727 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-6c1adafb-f9e1-411d-b8d5-90660581a1b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:52:40.135727 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:40.135727 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:40.135727 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:40.135727 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:40.135727 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:40.135727 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:40.135727 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:40.135727 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:40.135727 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:40.135727 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:40.135727 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:40.135727 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:52:40.135727 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:52:40.135727 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:52:40.135727 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:52:40.136670 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:52:40.136670 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:52:40.136670 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:52:40.136670 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:52:40.136670 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:40.136670 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:40.136670 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:40.136670 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:40.136670 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:40.136670 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:40.136670 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:40.136670 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:40.136670 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:40.136670 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:40.136670 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:40.136670 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:40.137516 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:40.137516 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:40.137516 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:40.137516 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:40.137516 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:52:40.137516 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:52:40.137516 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:52:40.137516 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:52:40.137516 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:52:40.137516 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:52:40.137516 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:52:40.137516 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:40.137516 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 324/635] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 27 18:52:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:40.138211 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1adafb-f9e1-411d-b8d5-90660581a1b3 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:40.197947 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28959e0c-eeef-44d4-8abe-68f0dd9fd3ac None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:40.236127 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741957f7-1df6-470b-9418-88462d5b7108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:40.236741 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741957f7-1df6-470b-9418-88462d5b7108 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:40.237021 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741957f7-1df6-470b-9418-88462d5b7108 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:40.237295 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741957f7-1df6-470b-9418-88462d5b7108 None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:40.237992 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741957f7-1df6-470b-9418-88462d5b7108 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:40.238294 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741957f7-1df6-470b-9418-88462d5b7108 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:40.239663 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741957f7-1df6-470b-9418-88462d5b7108 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:40.245068 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1adafb-f9e1-411d-b8d5-90660581a1b3 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:40.256094 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 312/636] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:52:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:40.256094 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741957f7-1df6-470b-9418-88462d5b7108 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:40.280329 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6269010-4675-4341-b8c2-455e3c944c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:40.280985 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6269010-4675-4341-b8c2-455e3c944c0f None admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:40.281268 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6269010-4675-4341-b8c2-455e3c944c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:40.281536 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6269010-4675-4341-b8c2-455e3c944c0f None admin] PATH_INFO: `/v3/projects/31f027c53398443eb548eaf3f24523e0/users/16a9f1909ab3458c8c131986e303831a/roles/306da3282d854292a7a53b8642ee373b` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:40.295360 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6269010-4675-4341-b8c2-455e3c944c0f None admin] RBAC: Authorizing `identity:create_grant(project_id=31f027c53398443eb548eaf3f24523e0, user_id=16a9f1909ab3458c8c131986e303831a, role_id=306da3282d854292a7a53b8642ee373b)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:40.296810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6269010-4675-4341-b8c2-455e3c944c0f None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:40.302688 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:40.311190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 325/637] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 27 18:52:40 2022] PUT /identity/v3/projects/31f027c53398443eb548eaf3f24523e0/users/16a9f1909ab3458c8c131986e303831a/roles/306da3282d854292a7a53b8642ee373b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:40.312054 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6269010-4675-4341-b8c2-455e3c944c0f None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:40.362051 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741957f7-1df6-470b-9418-88462d5b7108 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:40.378161 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:40.399476 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67875d8-95db-4d9d-aaa9-09ce37296087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:40.400140 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67875d8-95db-4d9d-aaa9-09ce37296087 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:40.400428 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67875d8-95db-4d9d-aaa9-09ce37296087 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:40.400705 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67875d8-95db-4d9d-aaa9-09ce37296087 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:40.401444 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67875d8-95db-4d9d-aaa9-09ce37296087 None admin] RBAC: Adding query filter params (name=service) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:40.401740 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67875d8-95db-4d9d-aaa9-09ce37296087 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:40.403134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67875d8-95db-4d9d-aaa9-09ce37296087 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:40.411787 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 313/638] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Jul 27 18:52:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:40.412641 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67875d8-95db-4d9d-aaa9-09ce37296087 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:40.445379 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6269010-4675-4341-b8c2-455e3c944c0f None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:40.490551 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1670b3b-abdd-4303-aceb-668ae6ea960d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:40.491165 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1670b3b-abdd-4303-aceb-668ae6ea960d None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:40.491442 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1670b3b-abdd-4303-aceb-668ae6ea960d None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:40.491737 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1670b3b-abdd-4303-aceb-668ae6ea960d None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:40.492645 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1670b3b-abdd-4303-aceb-668ae6ea960d None admin] RBAC: Adding query filter params (name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:40.493750 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1670b3b-abdd-4303-aceb-668ae6ea960d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:40.494430 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1670b3b-abdd-4303-aceb-668ae6ea960d None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:40.508075 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 326/639] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Jul 27 18:52:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:40.508075 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ebafa-f0aa-4f6c-86f0-54a298d4287c None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:40.508075 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ebafa-f0aa-4f6c-86f0-54a298d4287c None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:40.508075 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ebafa-f0aa-4f6c-86f0-54a298d4287c None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:40.508075 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 327/640] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:52:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:52:40.508075 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ebafa-f0aa-4f6c-86f0-54a298d4287c None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:40.536143 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67875d8-95db-4d9d-aaa9-09ce37296087 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:40.553045 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:40.581158 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778953ad-65b7-4d0e-946c-7d9a3ccf0a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:40.582336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778953ad-65b7-4d0e-946c-7d9a3ccf0a03 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:40.582614 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778953ad-65b7-4d0e-946c-7d9a3ccf0a03 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:40.582877 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778953ad-65b7-4d0e-946c-7d9a3ccf0a03 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:40.589713 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778953ad-65b7-4d0e-946c-7d9a3ccf0a03 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:40.591149 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778953ad-65b7-4d0e-946c-7d9a3ccf0a03 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:40.602465 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-778953ad-65b7-4d0e-946c-7d9a3ccf0a03 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:52:40.602465 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:40.602465 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:40.602465 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:40.602465 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:40.602465 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:40.602465 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:40.602465 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:40.602465 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:40.602465 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:40.602465 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:40.602465 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:40.602465 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:52:40.602465 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:52:40.602465 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:52:40.603375 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:52:40.603375 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:40.603375 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:40.603375 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:40.603375 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:40.603375 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:40.603375 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:40.603375 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:40.603375 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:40.603375 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:40.603375 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:40.603375 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:40.603375 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:40.603375 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:40.603375 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:40.603375 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:40.603375 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:40.604295 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:52:40.604295 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:52:40.604295 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:52:40.604295 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:52:40.604295 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:52:40.604295 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:52:40.604295 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:52:40.604295 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:40.604295 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 314/641] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 27 18:52:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:40.605191 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778953ad-65b7-4d0e-946c-7d9a3ccf0a03 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:40.628310 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ebafa-f0aa-4f6c-86f0-54a298d4287c None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:40.644503 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:40.670581 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f09300-59dd-4c29-a0f0-160b31c9dcb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:40.671557 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f09300-59dd-4c29-a0f0-160b31c9dcb0 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:40.672036 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f09300-59dd-4c29-a0f0-160b31c9dcb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:40.672460 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f09300-59dd-4c29-a0f0-160b31c9dcb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:40.683885 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f09300-59dd-4c29-a0f0-160b31c9dcb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:40.685597 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f09300-59dd-4c29-a0f0-160b31c9dcb0 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:40.700818 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-74f09300-59dd-4c29-a0f0-160b31c9dcb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:40.700818 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:40.700818 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:40.700818 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:40.700818 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:40.700818 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:40.700818 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:40.700818 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:40.700818 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:40.700818 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:40.700818 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:40.700818 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:40.700818 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:52:40.700818 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:52:40.700818 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:52:40.701949 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:52:40.701949 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:40.701949 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:40.701949 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:40.701949 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:40.701949 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:40.701949 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:40.701949 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:40.701949 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:40.701949 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:40.701949 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:40.701949 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:40.701949 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:40.701949 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:40.701949 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:40.701949 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:40.701949 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:40.703062 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:52:40.703062 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:52:40.703062 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:40.703062 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:40.704726 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 328/642] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:52:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:40.705925 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeeddad-8061-4fb4-b7ba-f8755613b239 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:40.706203 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeeddad-8061-4fb4-b7ba-f8755613b239 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:40.706471 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeeddad-8061-4fb4-b7ba-f8755613b239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:40.713570 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778953ad-65b7-4d0e-946c-7d9a3ccf0a03 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:40.725001 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-fdeeddad-8061-4fb4-b7ba-f8755613b239 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:40.726172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-fdeeddad-8061-4fb4-b7ba-f8755613b239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:40.748992 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c0617-6cfb-4d49-b928-84a75b30c79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:40.749630 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c0617-6cfb-4d49-b928-84a75b30c79a None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:40.749908 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c0617-6cfb-4d49-b928-84a75b30c79a None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:40.750174 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c0617-6cfb-4d49-b928-84a75b30c79a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:40.761114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1c0617-6cfb-4d49-b928-84a75b30c79a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:40.763097 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1c0617-6cfb-4d49-b928-84a75b30c79a None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:40.779036 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-7f1c0617-6cfb-4d49-b928-84a75b30c79a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:40.779036 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:40.779036 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:40.779036 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:40.779036 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:40.779036 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:40.779036 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:40.779036 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:40.779036 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:40.779036 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:40.779036 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:40.779036 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:40.779036 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:52:40.779036 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:52:40.779036 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:52:40.779989 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:52:40.779989 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:40.779989 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:40.779989 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:40.779989 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:40.779989 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:40.779989 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:40.779989 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:40.779989 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:40.779989 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:40.779989 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:40.779989 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:40.779989 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:40.779989 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:40.779989 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:40.779989 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:40.779989 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:40.781085 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:52:40.781085 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:52:40.781085 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:40.781085 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:40.781085 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 315/643] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:52:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:40.781509 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c0617-6cfb-4d49-b928-84a75b30c79a None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:40.803583 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 329/644] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:52:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:52:40.804421 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeeddad-8061-4fb4-b7ba-f8755613b239 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:40.821518 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:40.900184 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:40.900851 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c0617-6cfb-4d49-b928-84a75b30c79a None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:40.907713 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeeddad-8061-4fb4-b7ba-f8755613b239 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:40.936624 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b328f-9b9c-4043-85d5-c98bc66591e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:40.937232 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b328f-9b9c-4043-85d5-c98bc66591e9 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:40.937506 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b328f-9b9c-4043-85d5-c98bc66591e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:40.937776 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b328f-9b9c-4043-85d5-c98bc66591e9 None admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:40.938514 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26b328f-9b9c-4043-85d5-c98bc66591e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:40.938812 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26b328f-9b9c-4043-85d5-c98bc66591e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:40.940256 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26b328f-9b9c-4043-85d5-c98bc66591e9 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:40.944228 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3ebf5-937c-4b89-90b9-f5842838c783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:40.944945 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3ebf5-937c-4b89-90b9-f5842838c783 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:40.945328 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3ebf5-937c-4b89-90b9-f5842838c783 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:40.946238 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3ebf5-937c-4b89-90b9-f5842838c783 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:40.947028 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f3ebf5-937c-4b89-90b9-f5842838c783 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:40.947549 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f3ebf5-937c-4b89-90b9-f5842838c783 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:40.948895 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f3ebf5-937c-4b89-90b9-f5842838c783 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:40.957471 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 316/645] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 27 18:52:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:40.957471 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b328f-9b9c-4043-85d5-c98bc66591e9 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:40.968296 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 330/646] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:52:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:40.968999 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3ebf5-937c-4b89-90b9-f5842838c783 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:41.044463 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:41.061137 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b328f-9b9c-4043-85d5-c98bc66591e9 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:41.071324 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3ebf5-937c-4b89-90b9-f5842838c783 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:41.094529 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127ac17f-c96b-4fb7-b047-c1b24a21c6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:41.095269 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ac17f-c96b-4fb7-b047-c1b24a21c6a9 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:41.095641 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ac17f-c96b-4fb7-b047-c1b24a21c6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:41.096037 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ac17f-c96b-4fb7-b047-c1b24a21c6a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:41.096827 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127ac17f-c96b-4fb7-b047-c1b24a21c6a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:41.097227 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127ac17f-c96b-4fb7-b047-c1b24a21c6a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:41.098659 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127ac17f-c96b-4fb7-b047-c1b24a21c6a9 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:41.106295 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174590fc-5746-4d4f-be59-1328da379d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:41.106925 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174590fc-5746-4d4f-be59-1328da379d3e None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:41.107332 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174590fc-5746-4d4f-be59-1328da379d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:41.107610 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174590fc-5746-4d4f-be59-1328da379d3e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:41.110862 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 317/647] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:52:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:41.111799 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127ac17f-c96b-4fb7-b047-c1b24a21c6a9 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:41.123400 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174590fc-5746-4d4f-be59-1328da379d3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:52:41.129138 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-174590fc-5746-4d4f-be59-1328da379d3e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:52:41.129138 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:41.129138 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:41.129138 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:41.129138 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:41.129138 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:41.129138 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:41.129138 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:41.129138 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:41.129138 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:41.129138 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:41.129138 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:41.129138 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:52:41.129138 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:52:41.129138 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:52:41.129138 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:52:41.130248 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:52:41.130248 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:52:41.130248 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:52:41.130248 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:52:41.130248 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:41.130248 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:41.130248 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:41.130248 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:41.130248 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:41.130248 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:41.130248 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:41.130248 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:41.130248 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:41.130248 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:41.130248 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:41.130248 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:41.135864 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:41.135864 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:41.135864 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:41.135864 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:41.135864 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:52:41.135864 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:52:41.135864 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:52:41.135864 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:52:41.135864 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:52:41.135864 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:52:41.135864 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:52:41.135864 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:41.135864 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 331/648] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 27 18:52:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:41.135864 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174590fc-5746-4d4f-be59-1328da379d3e None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:41.147613 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:41.222554 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127ac17f-c96b-4fb7-b047-c1b24a21c6a9 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:41.241441 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174590fc-5746-4d4f-be59-1328da379d3e None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:41.258574 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab53bb3-6597-4f49-8c18-d0f91a5610cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:41.259183 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab53bb3-6597-4f49-8c18-d0f91a5610cf None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:41.259462 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab53bb3-6597-4f49-8c18-d0f91a5610cf None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:41.259758 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab53bb3-6597-4f49-8c18-d0f91a5610cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:41.260545 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab53bb3-6597-4f49-8c18-d0f91a5610cf None admin] RBAC: Adding query filter params (role.id=306da3282d854292a7a53b8642ee373b, scope.project.id=31f027c53398443eb548eaf3f24523e0, user.id=17fbef9db7734283aaad4962ee160171) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:41.260855 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab53bb3-6597-4f49-8c18-d0f91a5610cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:41.262277 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab53bb3-6597-4f49-8c18-d0f91a5610cf None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:41.268462 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 318/649] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 27 18:52:41 2022] GET /identity/v3/role_assignments?user.id=17fbef9db7734283aaad4962ee160171&scope.project.id=31f027c53398443eb548eaf3f24523e0&role.id=306da3282d854292a7a53b8642ee373b => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:41.269146 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab53bb3-6597-4f49-8c18-d0f91a5610cf None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:41.281092 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:41.290819 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f882b6aa-5faf-460f-8738-f40dcbc675ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:41.292427 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f882b6aa-5faf-460f-8738-f40dcbc675ed None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:41.292916 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f882b6aa-5faf-460f-8738-f40dcbc675ed None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:41.293413 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f882b6aa-5faf-460f-8738-f40dcbc675ed None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:41.306692 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f882b6aa-5faf-460f-8738-f40dcbc675ed None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:41.308808 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f882b6aa-5faf-460f-8738-f40dcbc675ed None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:41.327991 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-f882b6aa-5faf-460f-8738-f40dcbc675ed None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 18:52:41.327991 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:41.327991 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:41.327991 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:41.327991 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:41.327991 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:41.327991 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:41.327991 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:41.327991 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:41.327991 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:41.327991 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:41.327991 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:41.327991 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:52:41.327991 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:52:41.327991 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:52:41.327991 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:52:41.329033 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:41.329033 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:41.329033 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:52:41.329033 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:52:41.329033 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:52:41.329033 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:52:41.329033 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:41.329033 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:41.329033 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:41.329033 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:41.329033 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:41.329033 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:41.329033 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:41.329033 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:41.329033 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:41.329033 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:41.329033 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:41.329033 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:41.329971 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:41.329971 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:41.329971 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:52:41.329971 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:52:41.329971 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:52:41.329971 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:52:41.329971 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:52:41.329971 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:52:41.329971 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 18:52:41.329971 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:41.333449 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 332/650] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 27 18:52:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:41.335393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f882b6aa-5faf-460f-8738-f40dcbc675ed None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:41.390542 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab53bb3-6597-4f49-8c18-d0f91a5610cf None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:41.436244 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:41.442332 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faadf7c-eaa2-42ba-a799-ca57d5c145c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:41.442987 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faadf7c-eaa2-42ba-a799-ca57d5c145c4 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:41.443266 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faadf7c-eaa2-42ba-a799-ca57d5c145c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:41.443541 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faadf7c-eaa2-42ba-a799-ca57d5c145c4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:41.452701 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faadf7c-eaa2-42ba-a799-ca57d5c145c4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:41.453805 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faadf7c-eaa2-42ba-a799-ca57d5c145c4 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:41.467889 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-5faadf7c-eaa2-42ba-a799-ca57d5c145c4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 27 18:52:41.467889 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:41.467889 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:41.467889 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:41.467889 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:41.467889 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:41.467889 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:41.467889 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:41.467889 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:41.467889 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:41.467889 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:41.467889 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:41.467889 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:52:41.467889 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:52:41.467889 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:52:41.467889 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:52:41.468966 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:41.468966 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:41.468966 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:52:41.468966 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:52:41.468966 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:52:41.468966 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:52:41.468966 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:41.468966 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:41.468966 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:41.468966 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:41.468966 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:41.468966 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:41.468966 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:41.468966 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:41.468966 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:41.468966 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:41.468966 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:41.468966 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:41.470096 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:41.470096 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:41.470096 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:52:41.470096 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:52:41.470096 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:52:41.470096 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:52:41.470096 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:52:41.470096 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:52:41.470096 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 27 18:52:41.470096 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:41.470096 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 319/651] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 27 18:52:41 2022] GET /identity/v3/users/glance => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:41.470096 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faadf7c-eaa2-42ba-a799-ca57d5c145c4 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:41.476952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f882b6aa-5faf-460f-8738-f40dcbc675ed None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:41.514826 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22ad3c-b81e-43f1-b2f4-7af0b1715b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:41.515591 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22ad3c-b81e-43f1-b2f4-7af0b1715b3d None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:41.516042 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22ad3c-b81e-43f1-b2f4-7af0b1715b3d None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:41.516417 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22ad3c-b81e-43f1-b2f4-7af0b1715b3d None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:41.517453 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e22ad3c-b81e-43f1-b2f4-7af0b1715b3d None admin] RBAC: Adding query filter params (name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:41.517927 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e22ad3c-b81e-43f1-b2f4-7af0b1715b3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:41.522371 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e22ad3c-b81e-43f1-b2f4-7af0b1715b3d None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:41.535013 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 333/652] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Jul 27 18:52:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:41.536310 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22ad3c-b81e-43f1-b2f4-7af0b1715b3d None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:41.566239 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:41.610238 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faadf7c-eaa2-42ba-a799-ca57d5c145c4 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:41.644593 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da9846e-aae0-4b8c-a5d5-ce8cc884b1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:41.645205 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9846e-aae0-4b8c-a5d5-ce8cc884b1ba None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:41.645485 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9846e-aae0-4b8c-a5d5-ce8cc884b1ba None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:41.645757 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9846e-aae0-4b8c-a5d5-ce8cc884b1ba None admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:41.646551 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da9846e-aae0-4b8c-a5d5-ce8cc884b1ba None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:41.646861 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da9846e-aae0-4b8c-a5d5-ce8cc884b1ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:41.648375 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da9846e-aae0-4b8c-a5d5-ce8cc884b1ba None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:41.672517 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22ad3c-b81e-43f1-b2f4-7af0b1715b3d None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:41.673231 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 320/653] 10.222.0.20 () {56 vars in 1137 bytes} [Wed Jul 27 18:52:41 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:41.674554 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da9846e-aae0-4b8c-a5d5-ce8cc884b1ba None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:41.713588 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0794c68-ef16-48b3-8105-31ce665ed472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:41.714258 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0794c68-ef16-48b3-8105-31ce665ed472 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:41.714539 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0794c68-ef16-48b3-8105-31ce665ed472 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:41.714814 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0794c68-ef16-48b3-8105-31ce665ed472 None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:41.715799 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0794c68-ef16-48b3-8105-31ce665ed472 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:41.716109 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0794c68-ef16-48b3-8105-31ce665ed472 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:41.717687 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0794c68-ef16-48b3-8105-31ce665ed472 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:41.720450 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:41.739555 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 334/654] 10.222.0.20 () {56 vars in 1137 bytes} [Wed Jul 27 18:52:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:41.744788 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0794c68-ef16-48b3-8105-31ce665ed472 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:41.784124 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da9846e-aae0-4b8c-a5d5-ce8cc884b1ba None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:41.813139 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:41.823486 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e857ab7-8f1f-43db-8400-8c7574fd8027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:41.824051 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e857ab7-8f1f-43db-8400-8c7574fd8027 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:41.824433 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e857ab7-8f1f-43db-8400-8c7574fd8027 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:41.824805 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e857ab7-8f1f-43db-8400-8c7574fd8027 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:41.835771 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e857ab7-8f1f-43db-8400-8c7574fd8027 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:41.837557 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e857ab7-8f1f-43db-8400-8c7574fd8027 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:41.854313 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-8e857ab7-8f1f-43db-8400-8c7574fd8027 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:41.854313 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:41.854313 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:41.854313 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:41.854313 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:41.854313 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:41.854313 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:41.854313 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:41.854313 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:41.854313 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:41.854313 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:41.854313 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:41.854313 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:52:41.854313 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:52:41.854313 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:52:41.855425 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:52:41.855425 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:41.855425 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:41.855425 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:41.855425 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:41.855425 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:41.855425 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:41.855425 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:41.855425 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:41.855425 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:41.855425 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:41.855425 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:41.855425 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:41.855425 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:41.855425 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:41.855425 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:41.855425 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:41.856555 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:52:41.856555 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:52:41.856555 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:41.856555 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:41.862655 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 321/655] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:52:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:41.862655 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e857ab7-8f1f-43db-8400-8c7574fd8027 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:41.868861 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0794c68-ef16-48b3-8105-31ce665ed472 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:41.906313 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f82dfbb-0303-43d1-be63-b7ac85e608eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:41.907228 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82dfbb-0303-43d1-be63-b7ac85e608eb None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:41.907865 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82dfbb-0303-43d1-be63-b7ac85e608eb None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:41.908316 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82dfbb-0303-43d1-be63-b7ac85e608eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:41.969230 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e857ab7-8f1f-43db-8400-8c7574fd8027 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:41.984026 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:41.986955 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f82dfbb-0303-43d1-be63-b7ac85e608eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:41.988563 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f82dfbb-0303-43d1-be63-b7ac85e608eb None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:42.008196 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1c712b-c2d3-44b5-bc7f-d27b36e69f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:42.009101 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c712b-c2d3-44b5-bc7f-d27b36e69f8a None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:42.009975 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c712b-c2d3-44b5-bc7f-d27b36e69f8a None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:42.010472 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c712b-c2d3-44b5-bc7f-d27b36e69f8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:42.067147 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:42.091594 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1c712b-c2d3-44b5-bc7f-d27b36e69f8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:42.093084 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1c712b-c2d3-44b5-bc7f-d27b36e69f8a None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:42.117165 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 335/656] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 27 18:52:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:52:42.118456 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f82dfbb-0303-43d1-be63-b7ac85e608eb None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:42.198589 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 322/657] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 27 18:52:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:52:42.198589 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1c712b-c2d3-44b5-bc7f-d27b36e69f8a None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:42.226307 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:42.235182 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f82dfbb-0303-43d1-be63-b7ac85e608eb None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:42.273561 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e75311-6494-4cb7-9305-9cbd2bc07266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:42.275061 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e75311-6494-4cb7-9305-9cbd2bc07266 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:42.275797 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e75311-6494-4cb7-9305-9cbd2bc07266 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:42.276590 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e75311-6494-4cb7-9305-9cbd2bc07266 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:42.277828 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e75311-6494-4cb7-9305-9cbd2bc07266 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:42.278348 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e75311-6494-4cb7-9305-9cbd2bc07266 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:42.279957 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e75311-6494-4cb7-9305-9cbd2bc07266 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:42.281434 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:42.298044 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 336/658] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:52:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:42.299196 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e75311-6494-4cb7-9305-9cbd2bc07266 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:42.304670 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1c712b-c2d3-44b5-bc7f-d27b36e69f8a None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:42.340805 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9142ed-2bcf-49f9-be9f-e24db58c8ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:42.341435 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9142ed-2bcf-49f9-be9f-e24db58c8ef4 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:42.341712 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9142ed-2bcf-49f9-be9f-e24db58c8ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:42.341979 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9142ed-2bcf-49f9-be9f-e24db58c8ef4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:42.351960 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9142ed-2bcf-49f9-be9f-e24db58c8ef4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:42.353402 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9142ed-2bcf-49f9-be9f-e24db58c8ef4 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:42.368228 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-9a9142ed-2bcf-49f9-be9f-e24db58c8ef4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:42.368228 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:42.368228 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:42.368228 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:42.368228 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:42.368228 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:42.368228 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:42.368228 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:42.368228 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:42.368228 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:42.368228 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:42.368228 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:42.368228 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:52:42.368228 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:52:42.368228 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:52:42.369110 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:52:42.369110 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:42.369110 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:42.369110 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:42.369110 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:42.369110 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:42.369110 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:42.369110 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:42.369110 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:42.369110 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:42.369110 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:42.369110 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:42.369110 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:42.369110 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:42.369110 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:42.369110 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:42.369110 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:42.370006 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:52:42.370006 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:52:42.370006 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:42.370006 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:42.370006 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 323/659] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:52:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:42.370288 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9142ed-2bcf-49f9-be9f-e24db58c8ef4 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:42.410632 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e75311-6494-4cb7-9305-9cbd2bc07266 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:42.444997 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c98f11a-9e92-40c8-8ec1-19f8ddf00971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:42.446747 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98f11a-9e92-40c8-8ec1-19f8ddf00971 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:42.447239 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98f11a-9e92-40c8-8ec1-19f8ddf00971 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:42.447753 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98f11a-9e92-40c8-8ec1-19f8ddf00971 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:42.458414 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c98f11a-9e92-40c8-8ec1-19f8ddf00971 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:42.459902 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c98f11a-9e92-40c8-8ec1-19f8ddf00971 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:42.469209 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9142ed-2bcf-49f9-be9f-e24db58c8ef4 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:42.474147 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-5c98f11a-9e92-40c8-8ec1-19f8ddf00971 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:42.474147 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:42.474147 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:42.474147 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:42.474147 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:42.474147 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:42.474147 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:42.474147 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:42.474147 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:42.474147 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:42.474147 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:42.474147 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:42.474147 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:52:42.474147 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:52:42.474147 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:52:42.475042 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:52:42.475042 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:42.475042 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:42.475042 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:42.475042 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:42.475042 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:42.475042 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:42.475042 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:42.475042 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:42.475042 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:42.475042 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:42.475042 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:42.475042 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:42.475042 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:42.475042 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:42.475042 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:42.475042 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:42.475976 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:52:42.475976 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:52:42.475976 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:42.475976 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:42.483141 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 337/660] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:52:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:42.483141 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb70dc-aa32-4bb8-b481-b882ec82853d None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:42.483141 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb70dc-aa32-4bb8-b481-b882ec82853d None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:42.483141 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb70dc-aa32-4bb8-b481-b882ec82853d None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:42.483141 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 338/661] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:52:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:52:42.484262 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb70dc-aa32-4bb8-b481-b882ec82853d None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:42.493564 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:42.506083 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:42.512885 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2507402d-7bfc-4eec-8fd0-2358307ad096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:42.513394 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507402d-7bfc-4eec-8fd0-2358307ad096 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:42.513677 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507402d-7bfc-4eec-8fd0-2358307ad096 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:42.513970 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507402d-7bfc-4eec-8fd0-2358307ad096 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:42.524658 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2507402d-7bfc-4eec-8fd0-2358307ad096 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:42.526020 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2507402d-7bfc-4eec-8fd0-2358307ad096 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:42.541397 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-2507402d-7bfc-4eec-8fd0-2358307ad096 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 18:52:42.541397 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:42.541397 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:42.541397 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:42.541397 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:42.541397 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:42.541397 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:42.541397 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:42.541397 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:42.541397 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:42.541397 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:42.541397 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:42.541397 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:52:42.541397 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:52:42.541397 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:52:42.541397 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:52:42.542339 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:42.542339 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:42.542339 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:52:42.542339 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:52:42.542339 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:52:42.542339 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:52:42.542339 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:42.542339 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:42.542339 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:42.542339 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:42.542339 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:42.542339 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:42.542339 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:42.542339 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:42.542339 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:42.542339 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:42.542339 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:42.542339 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:42.543307 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:42.543307 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:42.543307 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:52:42.543307 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:52:42.543307 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:52:42.543307 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:52:42.543307 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:52:42.543307 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:52:42.543307 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 18:52:42.543307 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:42.543307 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 324/662] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 27 18:52:42 2022] GET /identity/v3/users/neutron => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:42.543307 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2507402d-7bfc-4eec-8fd0-2358307ad096 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:42.604078 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb70dc-aa32-4bb8-b481-b882ec82853d None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:42.639137 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce0ef1-c5bf-4396-93d1-631c2319d035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:42.639787 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce0ef1-c5bf-4396-93d1-631c2319d035 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:42.640065 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce0ef1-c5bf-4396-93d1-631c2319d035 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:42.640338 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce0ef1-c5bf-4396-93d1-631c2319d035 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:42.641037 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce0ef1-c5bf-4396-93d1-631c2319d035 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:42.641338 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce0ef1-c5bf-4396-93d1-631c2319d035 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:42.642690 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce0ef1-c5bf-4396-93d1-631c2319d035 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:42.651720 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2507402d-7bfc-4eec-8fd0-2358307ad096 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:42.655364 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 339/663] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:52:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:42.660763 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89cb670-93f3-484d-9aa6-890017134bc7 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:42.661050 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89cb670-93f3-484d-9aa6-890017134bc7 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:42.661325 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89cb670-93f3-484d-9aa6-890017134bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:42.678452 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-e89cb670-93f3-484d-9aa6-890017134bc7 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:42.679629 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-e89cb670-93f3-484d-9aa6-890017134bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:42.686659 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e090282-4fc0-41ce-97d4-55b3812eccb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:42.687260 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e090282-4fc0-41ce-97d4-55b3812eccb9 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:42.687538 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e090282-4fc0-41ce-97d4-55b3812eccb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:42.687839 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e090282-4fc0-41ce-97d4-55b3812eccb9 None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:42.688518 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e090282-4fc0-41ce-97d4-55b3812eccb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:42.689084 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e090282-4fc0-41ce-97d4-55b3812eccb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:42.690146 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e090282-4fc0-41ce-97d4-55b3812eccb9 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:42.707325 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 325/664] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:52:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:42.707325 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e090282-4fc0-41ce-97d4-55b3812eccb9 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:42.745769 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:42.759857 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 340/665] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:52:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:52:42.759857 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89cb670-93f3-484d-9aa6-890017134bc7 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:42.767498 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:42.815894 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e090282-4fc0-41ce-97d4-55b3812eccb9 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:42.850394 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d114c1-69a4-4d68-a071-4215813b9c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:42.851365 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d114c1-69a4-4d68-a071-4215813b9c5d None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:42.851653 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d114c1-69a4-4d68-a071-4215813b9c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:42.852017 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d114c1-69a4-4d68-a071-4215813b9c5d None admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:42.852812 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d114c1-69a4-4d68-a071-4215813b9c5d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:42.853125 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d114c1-69a4-4d68-a071-4215813b9c5d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:42.854539 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d114c1-69a4-4d68-a071-4215813b9c5d None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:42.871562 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89cb670-93f3-484d-9aa6-890017134bc7 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:42.872749 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 326/666] 10.222.0.20 () {56 vars in 1139 bytes} [Wed Jul 27 18:52:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:42.873461 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d114c1-69a4-4d68-a071-4215813b9c5d None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:42.910320 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828febaa-0a2c-4eeb-8b66-57f66eb0ba0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:42.910960 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828febaa-0a2c-4eeb-8b66-57f66eb0ba0a None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:42.911241 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828febaa-0a2c-4eeb-8b66-57f66eb0ba0a None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:42.911514 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828febaa-0a2c-4eeb-8b66-57f66eb0ba0a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:42.918870 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828febaa-0a2c-4eeb-8b66-57f66eb0ba0a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:42.920330 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828febaa-0a2c-4eeb-8b66-57f66eb0ba0a None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:42.931496 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-828febaa-0a2c-4eeb-8b66-57f66eb0ba0a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:52:42.931496 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:42.931496 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:42.931496 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:42.931496 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:42.931496 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:42.931496 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:42.931496 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:42.931496 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:42.931496 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:42.931496 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:42.931496 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:42.931496 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:52:42.931496 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:52:42.931496 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:52:42.932416 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:52:42.932416 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:42.932416 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:42.932416 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:42.932416 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:42.932416 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:42.932416 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:42.932416 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:42.932416 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:42.932416 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:42.932416 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:42.932416 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:42.932416 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:42.932416 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:42.932416 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:42.932416 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:42.932416 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:42.933310 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:52:42.933310 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:52:42.933310 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:52:42.933310 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:52:42.933310 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:52:42.933310 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:52:42.933310 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:52:42.933310 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:42.933310 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 341/667] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 27 18:52:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:42.933792 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828febaa-0a2c-4eeb-8b66-57f66eb0ba0a None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:42.984083 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d114c1-69a4-4d68-a071-4215813b9c5d None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:42.992651 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:42.998877 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:43.027293 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab1d90-a6ff-4af5-a29e-94454e416eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:43.027954 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab1d90-a6ff-4af5-a29e-94454e416eb4 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:43.028233 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab1d90-a6ff-4af5-a29e-94454e416eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:43.028500 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab1d90-a6ff-4af5-a29e-94454e416eb4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:43.035629 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cab1d90-a6ff-4af5-a29e-94454e416eb4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:43.037061 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cab1d90-a6ff-4af5-a29e-94454e416eb4 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:43.041087 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828febaa-0a2c-4eeb-8b66-57f66eb0ba0a None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:43.048893 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-9cab1d90-a6ff-4af5-a29e-94454e416eb4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:52:43.048893 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:43.048893 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:43.048893 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:43.048893 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:43.048893 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:43.048893 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:43.048893 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:43.048893 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:43.048893 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:43.048893 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:43.048893 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:43.048893 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:52:43.048893 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:52:43.048893 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:52:43.049953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:52:43.049953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:43.049953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:43.049953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:43.049953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:43.049953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:43.049953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:43.049953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:43.049953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:43.049953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:43.049953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:43.049953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:43.049953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:43.049953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:43.049953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:43.049953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:43.049953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:43.055985 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:52:43.055985 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:52:43.055985 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:52:43.055985 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:52:43.055985 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:52:43.055985 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:52:43.055985 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:52:43.055985 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:43.055985 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 327/668] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 27 18:52:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:43.055985 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab1d90-a6ff-4af5-a29e-94454e416eb4 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:43.084363 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717a45a0-2a52-42f6-93bc-51b9476f228c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:43.084936 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a45a0-2a52-42f6-93bc-51b9476f228c None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:43.085225 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a45a0-2a52-42f6-93bc-51b9476f228c None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:43.085498 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a45a0-2a52-42f6-93bc-51b9476f228c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:43.096670 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717a45a0-2a52-42f6-93bc-51b9476f228c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:52:43.102584 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-717a45a0-2a52-42f6-93bc-51b9476f228c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:52:43.102584 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:43.102584 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:43.102584 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:43.102584 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:43.102584 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:43.102584 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:43.102584 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:43.102584 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:43.102584 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:43.102584 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:43.102584 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:43.102584 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:52:43.102584 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:52:43.102584 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:52:43.102584 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:52:43.103495 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:52:43.103495 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:52:43.103495 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:52:43.103495 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:52:43.103495 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:43.103495 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:43.103495 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:43.103495 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:43.103495 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:43.103495 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:43.103495 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:43.103495 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:43.103495 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:43.103495 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:43.103495 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:43.103495 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:43.104393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:43.104393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:43.104393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:43.104393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:43.104393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:52:43.104393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:52:43.104393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:52:43.104393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:52:43.104393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:52:43.104393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:52:43.104393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:52:43.104393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:43.108828 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 342/669] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 27 18:52:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:43.109641 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717a45a0-2a52-42f6-93bc-51b9476f228c None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:43.159734 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab1d90-a6ff-4af5-a29e-94454e416eb4 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:43.195438 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed199c-cf78-4422-95f6-fa706d57738a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:43.196636 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed199c-cf78-4422-95f6-fa706d57738a None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:43.196921 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed199c-cf78-4422-95f6-fa706d57738a None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:43.197199 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed199c-cf78-4422-95f6-fa706d57738a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:43.217039 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717a45a0-2a52-42f6-93bc-51b9476f228c None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:43.233913 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:43.237112 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:43.256147 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6142a6e-17d3-4d28-90e0-4b03727e2fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:43.256762 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6142a6e-17d3-4d28-90e0-4b03727e2fe4 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:43.257046 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6142a6e-17d3-4d28-90e0-4b03727e2fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:43.257322 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6142a6e-17d3-4d28-90e0-4b03727e2fe4 None admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:43.258095 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6142a6e-17d3-4d28-90e0-4b03727e2fe4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:43.258409 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6142a6e-17d3-4d28-90e0-4b03727e2fe4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:43.259863 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6142a6e-17d3-4d28-90e0-4b03727e2fe4 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:43.271582 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 343/670] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 27 18:52:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:43.276528 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6142a6e-17d3-4d28-90e0-4b03727e2fe4 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:43.278178 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed199c-cf78-4422-95f6-fa706d57738a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:43.280593 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed199c-cf78-4422-95f6-fa706d57738a None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:43.386620 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6142a6e-17d3-4d28-90e0-4b03727e2fe4 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:43.403078 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 328/671] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 27 18:52:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:52:43.403078 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed199c-cf78-4422-95f6-fa706d57738a None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:43.425656 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed7331-8c46-4fc4-9bc9-cdda723633de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:43.426272 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed7331-8c46-4fc4-9bc9-cdda723633de None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:43.426557 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed7331-8c46-4fc4-9bc9-cdda723633de None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:43.426831 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed7331-8c46-4fc4-9bc9-cdda723633de None admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:43.427577 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ed7331-8c46-4fc4-9bc9-cdda723633de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:43.427915 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ed7331-8c46-4fc4-9bc9-cdda723633de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:43.429326 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ed7331-8c46-4fc4-9bc9-cdda723633de None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:43.447178 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 344/672] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 27 18:52:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:43.447178 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed7331-8c46-4fc4-9bc9-cdda723633de None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:43.469791 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:43.484000 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:43.504810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed199c-cf78-4422-95f6-fa706d57738a None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:43.538900 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f5a7ee-eb4a-4b6a-b488-c7a866a40f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:43.540058 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5a7ee-eb4a-4b6a-b488-c7a866a40f0d None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:43.540340 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5a7ee-eb4a-4b6a-b488-c7a866a40f0d None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:43.540611 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5a7ee-eb4a-4b6a-b488-c7a866a40f0d None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:43.541320 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f5a7ee-eb4a-4b6a-b488-c7a866a40f0d None admin] RBAC: Adding query filter params (name=service) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:43.541619 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f5a7ee-eb4a-4b6a-b488-c7a866a40f0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:43.542970 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f5a7ee-eb4a-4b6a-b488-c7a866a40f0d None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:43.550780 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 329/673] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Jul 27 18:52:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:43.551544 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f5a7ee-eb4a-4b6a-b488-c7a866a40f0d None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:43.557958 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed7331-8c46-4fc4-9bc9-cdda723633de None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:43.591189 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c67161-aef6-4879-8c05-858f92dbae94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:43.591831 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c67161-aef6-4879-8c05-858f92dbae94 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:43.592113 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c67161-aef6-4879-8c05-858f92dbae94 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:43.592387 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c67161-aef6-4879-8c05-858f92dbae94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:43.593179 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c67161-aef6-4879-8c05-858f92dbae94 None admin] RBAC: Adding query filter params (role.id=306da3282d854292a7a53b8642ee373b, scope.project.id=31f027c53398443eb548eaf3f24523e0, user.id=d5525865e12c41fe8da761cd25c14e2e) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:43.593488 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c67161-aef6-4879-8c05-858f92dbae94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:43.594902 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c67161-aef6-4879-8c05-858f92dbae94 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:43.600945 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 345/674] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 27 18:52:43 2022] GET /identity/v3/role_assignments?user.id=d5525865e12c41fe8da761cd25c14e2e&scope.project.id=31f027c53398443eb548eaf3f24523e0&role.id=306da3282d854292a7a53b8642ee373b => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:43.601734 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c67161-aef6-4879-8c05-858f92dbae94 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:43.663990 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f5a7ee-eb4a-4b6a-b488-c7a866a40f0d None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:43.695794 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:43.704219 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff04a1d-d8c7-41d5-936e-885bd1e15b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:43.704868 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff04a1d-d8c7-41d5-936e-885bd1e15b62 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:43.705144 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff04a1d-d8c7-41d5-936e-885bd1e15b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:43.705411 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff04a1d-d8c7-41d5-936e-885bd1e15b62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:43.717571 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff04a1d-d8c7-41d5-936e-885bd1e15b62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:43.719106 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff04a1d-d8c7-41d5-936e-885bd1e15b62 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:43.720647 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:43.724289 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c67161-aef6-4879-8c05-858f92dbae94 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:43.736061 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-aff04a1d-d8c7-41d5-936e-885bd1e15b62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:43.736061 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:43.736061 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:43.736061 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:43.736061 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:43.736061 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:43.736061 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:43.736061 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:43.736061 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:43.736061 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:43.736061 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:43.736061 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:43.736061 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:52:43.736061 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:52:43.736061 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:52:43.737058 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:52:43.737058 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:43.737058 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:43.737058 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:43.737058 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:43.737058 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:43.737058 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:43.737058 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:43.737058 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:43.737058 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:43.737058 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:43.737058 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:43.737058 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:43.737058 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:43.737058 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:43.737058 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:43.737058 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:43.737934 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:52:43.737934 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:52:43.737934 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:43.737934 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:43.739849 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 330/675] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:52:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:43.741591 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdae8ec-c29a-41a2-b874-f797812af823 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:43.742575 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdae8ec-c29a-41a2-b874-f797812af823 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:43.743081 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdae8ec-c29a-41a2-b874-f797812af823 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:43.744659 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 331/676] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:52:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:52:43.745579 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdae8ec-c29a-41a2-b874-f797812af823 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:43.771052 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7780b2aa-57a6-4579-8540-8fac3b9c0408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:43.771671 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780b2aa-57a6-4579-8540-8fac3b9c0408 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:43.771994 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780b2aa-57a6-4579-8540-8fac3b9c0408 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:43.772266 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780b2aa-57a6-4579-8540-8fac3b9c0408 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:43.773064 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7780b2aa-57a6-4579-8540-8fac3b9c0408 None admin] RBAC: Adding query filter params (role.id=306da3282d854292a7a53b8642ee373b, scope.project.id=31f027c53398443eb548eaf3f24523e0, user.id=6c4b9109e80b4ae19a7c31de1cd9d2b9) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:43.773377 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7780b2aa-57a6-4579-8540-8fac3b9c0408 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:43.775331 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7780b2aa-57a6-4579-8540-8fac3b9c0408 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:43.781561 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 346/677] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 27 18:52:43 2022] GET /identity/v3/role_assignments?user.id=6c4b9109e80b4ae19a7c31de1cd9d2b9&scope.project.id=31f027c53398443eb548eaf3f24523e0&role.id=306da3282d854292a7a53b8642ee373b => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:43.782373 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7780b2aa-57a6-4579-8540-8fac3b9c0408 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:43.877536 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdae8ec-c29a-41a2-b874-f797812af823 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:43.917960 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ae2da9-5b73-4873-80da-60e2661a9783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:43.918550 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae2da9-5b73-4873-80da-60e2661a9783 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:43.918834 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae2da9-5b73-4873-80da-60e2661a9783 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:43.919108 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae2da9-5b73-4873-80da-60e2661a9783 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:43.931294 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ae2da9-5b73-4873-80da-60e2661a9783 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:43.931506 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7780b2aa-57a6-4579-8540-8fac3b9c0408 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:43.932833 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ae2da9-5b73-4873-80da-60e2661a9783 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:43.949827 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-23ae2da9-5b73-4873-80da-60e2661a9783 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:43.949827 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:43.949827 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:43.949827 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:43.949827 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:43.949827 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:43.949827 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:43.949827 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:43.949827 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:43.949827 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:43.949827 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:43.949827 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:43.949827 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:52:43.949827 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:52:43.949827 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:52:43.950765 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:52:43.950765 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:43.950765 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:43.950765 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:43.950765 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:43.950765 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:43.950765 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:43.950765 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:43.950765 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:43.950765 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:43.950765 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:43.950765 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:43.950765 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:43.950765 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:43.950765 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:43.950765 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:43.950765 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:43.951651 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:52:43.951651 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:52:43.951651 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:43.951651 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:43.955768 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 332/678] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:52:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:43.957419 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66892cb-20c0-483d-8b24-b0a803e4ac42 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:43.957932 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66892cb-20c0-483d-8b24-b0a803e4ac42 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:43.958393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66892cb-20c0-483d-8b24-b0a803e4ac42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:43.972086 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9586e764-c3fd-421a-a87c-3becdc04407d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:43.972711 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9586e764-c3fd-421a-a87c-3becdc04407d None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:43.972990 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9586e764-c3fd-421a-a87c-3becdc04407d None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:43.973264 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9586e764-c3fd-421a-a87c-3becdc04407d None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:43.974085 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9586e764-c3fd-421a-a87c-3becdc04407d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:43.974394 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9586e764-c3fd-421a-a87c-3becdc04407d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:43.976465 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9586e764-c3fd-421a-a87c-3becdc04407d None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:43.981139 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-b66892cb-20c0-483d-8b24-b0a803e4ac42 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:43.982589 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-b66892cb-20c0-483d-8b24-b0a803e4ac42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:43.994045 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 347/679] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:52:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:43.998648 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9586e764-c3fd-421a-a87c-3becdc04407d None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:44.014224 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:44.029347 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:44.079961 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 333/680] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:52:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:52:44.081217 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66892cb-20c0-483d-8b24-b0a803e4ac42 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:44.133511 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9586e764-c3fd-421a-a87c-3becdc04407d None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:44.170637 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40534256-6c1b-4860-8da2-1a8813669e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:44.171678 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40534256-6c1b-4860-8da2-1a8813669e07 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:44.172291 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40534256-6c1b-4860-8da2-1a8813669e07 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:44.172789 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40534256-6c1b-4860-8da2-1a8813669e07 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:44.173684 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40534256-6c1b-4860-8da2-1a8813669e07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:44.174190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40534256-6c1b-4860-8da2-1a8813669e07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:44.175767 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40534256-6c1b-4860-8da2-1a8813669e07 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:44.188856 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 348/681] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:52:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:44.194299 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40534256-6c1b-4860-8da2-1a8813669e07 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:44.212410 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66892cb-20c0-483d-8b24-b0a803e4ac42 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:44.248626 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a445b-80dc-49ac-8041-dbac147fb477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:44.249667 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a445b-80dc-49ac-8041-dbac147fb477 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:44.250152 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a445b-80dc-49ac-8041-dbac147fb477 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:44.250638 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a445b-80dc-49ac-8041-dbac147fb477 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:44.258523 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1a445b-80dc-49ac-8041-dbac147fb477 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:44.260307 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1a445b-80dc-49ac-8041-dbac147fb477 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:44.272144 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-da1a445b-80dc-49ac-8041-dbac147fb477 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:52:44.272144 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:44.272144 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:44.272144 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:44.272144 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:44.272144 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:44.272144 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:44.272144 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:44.272144 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:44.272144 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:44.272144 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:44.272144 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:44.272144 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:52:44.272144 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:52:44.272144 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:52:44.273075 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:52:44.273075 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:44.273075 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:44.273075 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:44.273075 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:44.273075 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:44.273075 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:44.273075 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:44.273075 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:44.273075 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:44.273075 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:44.273075 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:44.273075 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:44.273075 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:44.273075 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:44.273075 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:44.273075 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:44.274543 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:52:44.274543 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:52:44.274543 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:52:44.274543 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:52:44.274543 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:52:44.274543 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:52:44.274543 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:52:44.274543 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:44.276983 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 334/682] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 27 18:52:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:44.278049 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a445b-80dc-49ac-8041-dbac147fb477 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:44.286210 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:44.304163 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40534256-6c1b-4860-8da2-1a8813669e07 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:44.306569 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:44.340857 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a2dc8-402c-4e60-bf9f-860eec78eb57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:44.341495 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a2dc8-402c-4e60-bf9f-860eec78eb57 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:44.341775 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a2dc8-402c-4e60-bf9f-860eec78eb57 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:44.342048 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a2dc8-402c-4e60-bf9f-860eec78eb57 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:44.352871 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553a2dc8-402c-4e60-bf9f-860eec78eb57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:52:44.358317 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-553a2dc8-402c-4e60-bf9f-860eec78eb57 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:52:44.358317 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:44.358317 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:44.358317 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:44.358317 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:44.358317 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:44.358317 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:44.358317 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:44.358317 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:44.358317 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:44.358317 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:44.358317 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:44.358317 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:52:44.358317 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:52:44.358317 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:52:44.358317 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:52:44.359282 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:52:44.359282 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:52:44.359282 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:52:44.359282 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:52:44.359282 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:44.359282 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:44.359282 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:44.359282 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:44.359282 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:44.359282 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:44.359282 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:44.359282 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:44.359282 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:44.359282 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:44.359282 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:44.359282 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:44.360195 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:44.360195 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:44.360195 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:44.360195 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:44.360195 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:52:44.360195 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:52:44.360195 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:52:44.360195 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:52:44.360195 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:52:44.360195 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:52:44.360195 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:52:44.360195 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:44.364737 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 349/683] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 27 18:52:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:44.365663 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a2dc8-402c-4e60-bf9f-860eec78eb57 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:44.395167 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a445b-80dc-49ac-8041-dbac147fb477 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:44.435099 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ffdea-7c0c-4668-a0b7-d5ecbe3fb800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:44.436270 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ffdea-7c0c-4668-a0b7-d5ecbe3fb800 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:44.436759 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ffdea-7c0c-4668-a0b7-d5ecbe3fb800 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:44.437694 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ffdea-7c0c-4668-a0b7-d5ecbe3fb800 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:44.446923 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9ffdea-7c0c-4668-a0b7-d5ecbe3fb800 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:44.449051 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9ffdea-7c0c-4668-a0b7-d5ecbe3fb800 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:44.465202 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-aa9ffdea-7c0c-4668-a0b7-d5ecbe3fb800 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 18:52:44.465202 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:44.465202 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:44.465202 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:44.465202 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:44.465202 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:44.465202 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:44.465202 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:44.465202 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:44.465202 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:44.465202 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:44.465202 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:44.465202 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:52:44.465202 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:52:44.465202 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:52:44.465202 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:52:44.466164 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:44.466164 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:44.466164 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:52:44.466164 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:52:44.466164 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:52:44.466164 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:52:44.466164 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:44.466164 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:44.466164 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:44.466164 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:44.466164 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:44.466164 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:44.466164 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:44.466164 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:44.466164 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:44.466164 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:44.466164 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:44.466164 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:44.467129 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:44.467129 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:44.467129 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:52:44.467129 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:52:44.467129 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:52:44.467129 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:52:44.467129 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:52:44.467129 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:52:44.467129 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 18:52:44.467129 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:44.473850 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 335/684] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 27 18:52:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:44.473850 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ffdea-7c0c-4668-a0b7-d5ecbe3fb800 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:44.484121 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a2dc8-402c-4e60-bf9f-860eec78eb57 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:44.524317 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b64104f-7884-4e8c-8a89-c0d57708df68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:44.524935 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64104f-7884-4e8c-8a89-c0d57708df68 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:44.525214 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64104f-7884-4e8c-8a89-c0d57708df68 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:44.525487 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64104f-7884-4e8c-8a89-c0d57708df68 None admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:44.526233 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b64104f-7884-4e8c-8a89-c0d57708df68 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:44.526540 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b64104f-7884-4e8c-8a89-c0d57708df68 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:44.528483 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b64104f-7884-4e8c-8a89-c0d57708df68 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:44.546476 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 350/685] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 27 18:52:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:44.547361 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b64104f-7884-4e8c-8a89-c0d57708df68 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:44.576057 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:44.591145 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:44.614406 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ffdea-7c0c-4668-a0b7-d5ecbe3fb800 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:44.656886 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b64104f-7884-4e8c-8a89-c0d57708df68 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:44.680466 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e7bd2-a573-4631-be90-a92b92034a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:44.682050 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e7bd2-a573-4631-be90-a92b92034a7a None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:44.682898 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e7bd2-a573-4631-be90-a92b92034a7a None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:44.683872 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e7bd2-a573-4631-be90-a92b92034a7a None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:44.685067 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e7bd2-a573-4631-be90-a92b92034a7a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:44.685808 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e7bd2-a573-4631-be90-a92b92034a7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:44.688536 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e7bd2-a573-4631-be90-a92b92034a7a None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:44.695095 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa98da36-c1c4-47ea-b55c-902f6aedda7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:44.696324 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa98da36-c1c4-47ea-b55c-902f6aedda7b None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:44.696674 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa98da36-c1c4-47ea-b55c-902f6aedda7b None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:44.697031 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa98da36-c1c4-47ea-b55c-902f6aedda7b None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:44.697891 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa98da36-c1c4-47ea-b55c-902f6aedda7b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:44.698266 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa98da36-c1c4-47ea-b55c-902f6aedda7b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:44.699889 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa98da36-c1c4-47ea-b55c-902f6aedda7b None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:44.706093 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 336/686] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 27 18:52:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:44.707619 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e7bd2-a573-4631-be90-a92b92034a7a None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:44.732649 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 351/687] 10.222.0.20 () {56 vars in 1135 bytes} [Wed Jul 27 18:52:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:44.732649 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa98da36-c1c4-47ea-b55c-902f6aedda7b None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:44.804053 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:44.838460 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e7bd2-a573-4631-be90-a92b92034a7a None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:44.841840 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa98da36-c1c4-47ea-b55c-902f6aedda7b None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:44.878319 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e392113-7167-4d9c-baf0-e2f56bb702c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:44.879457 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e392113-7167-4d9c-baf0-e2f56bb702c8 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:44.879976 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e392113-7167-4d9c-baf0-e2f56bb702c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:44.880561 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e392113-7167-4d9c-baf0-e2f56bb702c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:44.881018 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309647eb-76a6-4383-a971-a0831e0a83bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:44.881625 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309647eb-76a6-4383-a971-a0831e0a83bf None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:44.881926 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309647eb-76a6-4383-a971-a0831e0a83bf None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:44.882175 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309647eb-76a6-4383-a971-a0831e0a83bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:44.883043 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309647eb-76a6-4383-a971-a0831e0a83bf None admin] RBAC: Adding query filter params (role.id=306da3282d854292a7a53b8642ee373b, scope.project.id=31f027c53398443eb548eaf3f24523e0, user.id=703f0431d017405d942539de93a565b7) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:44.883285 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309647eb-76a6-4383-a971-a0831e0a83bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:44.885203 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309647eb-76a6-4383-a971-a0831e0a83bf None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:44.892356 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 337/688] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 27 18:52:44 2022] GET /identity/v3/role_assignments?user.id=703f0431d017405d942539de93a565b7&scope.project.id=31f027c53398443eb548eaf3f24523e0&role.id=306da3282d854292a7a53b8642ee373b => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:44.893179 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e392113-7167-4d9c-baf0-e2f56bb702c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:44.893307 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309647eb-76a6-4383-a971-a0831e0a83bf None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:44.895041 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e392113-7167-4d9c-baf0-e2f56bb702c8 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:44.920786 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:44.924039 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-1e392113-7167-4d9c-baf0-e2f56bb702c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:44.924039 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:44.924039 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:44.924039 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:44.924039 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:44.924039 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:44.924039 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:44.924039 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:44.924039 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:44.924039 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:44.924039 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:44.924039 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:44.924039 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:52:44.924039 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:52:44.924039 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:52:44.925341 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:52:44.925341 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:44.925341 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:44.925341 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:44.925341 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:44.925341 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:44.925341 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:44.925341 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:44.925341 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:44.925341 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:44.925341 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:44.925341 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:44.925341 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:44.925341 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:44.925341 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:44.925341 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:44.925341 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:44.926246 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:52:44.926246 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:52:44.926246 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:44.926246 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:44.931179 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 352/689] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:52:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:44.938146 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e392113-7167-4d9c-baf0-e2f56bb702c8 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:45.093651 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309647eb-76a6-4383-a971-a0831e0a83bf None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:45.108981 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e392113-7167-4d9c-baf0-e2f56bb702c8 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:45.130766 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:45.135828 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3058f5-8e8e-4f4c-a476-4fd37a5df357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:45.136570 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3058f5-8e8e-4f4c-a476-4fd37a5df357 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:45.136853 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3058f5-8e8e-4f4c-a476-4fd37a5df357 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:45.137239 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3058f5-8e8e-4f4c-a476-4fd37a5df357 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:45.161091 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a846b6d9-e483-4eb3-8382-c81369d38c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:45.162595 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846b6d9-e483-4eb3-8382-c81369d38c10 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:45.163133 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846b6d9-e483-4eb3-8382-c81369d38c10 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:45.163915 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846b6d9-e483-4eb3-8382-c81369d38c10 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:45.165651 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a846b6d9-e483-4eb3-8382-c81369d38c10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:45.166173 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a846b6d9-e483-4eb3-8382-c81369d38c10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:45.168576 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a846b6d9-e483-4eb3-8382-c81369d38c10 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:45.186328 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 353/690] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:52:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:45.193240 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a846b6d9-e483-4eb3-8382-c81369d38c10 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:45.226513 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3058f5-8e8e-4f4c-a476-4fd37a5df357 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:45.228249 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3058f5-8e8e-4f4c-a476-4fd37a5df357 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:45.241362 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:45.349866 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a846b6d9-e483-4eb3-8382-c81369d38c10 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:45.354563 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 338/691] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 27 18:52:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:52:45.361879 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3058f5-8e8e-4f4c-a476-4fd37a5df357 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:45.416156 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2210e6d7-0f35-4dc1-b495-be7a9bca2865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:45.417211 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210e6d7-0f35-4dc1-b495-be7a9bca2865 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:45.417699 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210e6d7-0f35-4dc1-b495-be7a9bca2865 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:45.418203 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210e6d7-0f35-4dc1-b495-be7a9bca2865 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:45.426302 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2210e6d7-0f35-4dc1-b495-be7a9bca2865 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:45.428014 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2210e6d7-0f35-4dc1-b495-be7a9bca2865 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:45.440962 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-2210e6d7-0f35-4dc1-b495-be7a9bca2865 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 18:52:45.440962 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:45.440962 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:45.440962 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:45.440962 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:45.440962 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:45.440962 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:45.440962 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:45.440962 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:45.440962 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:45.440962 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:45.440962 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:45.440962 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:52:45.440962 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:52:45.440962 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:52:45.440962 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:52:45.442040 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:45.442040 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:45.442040 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:52:45.442040 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:52:45.442040 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:52:45.442040 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:52:45.442040 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:45.442040 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:45.442040 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:45.442040 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:45.442040 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:45.442040 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:45.442040 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:45.442040 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:45.442040 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:45.442040 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:45.442040 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:45.442040 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:45.442998 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:45.442998 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:45.442998 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:52:45.442998 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:52:45.442998 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:52:45.442998 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:52:45.442998 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:52:45.442998 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:52:45.442998 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 18:52:45.442998 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:45.446160 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 354/692] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Jul 27 18:52:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:52:45.452585 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2210e6d7-0f35-4dc1-b495-be7a9bca2865 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:45.518105 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:45.561887 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3058f5-8e8e-4f4c-a476-4fd37a5df357 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:45.593543 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:45.625100 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2210e6d7-0f35-4dc1-b495-be7a9bca2865 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:45.629948 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca8e5e0-96d0-42e6-b5c0-872558db5af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:45.629948 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8e5e0-96d0-42e6-b5c0-872558db5af7 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:45.629948 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8e5e0-96d0-42e6-b5c0-872558db5af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:45.629948 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8e5e0-96d0-42e6-b5c0-872558db5af7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:45.644831 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca8e5e0-96d0-42e6-b5c0-872558db5af7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:45.647116 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca8e5e0-96d0-42e6-b5c0-872558db5af7 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:45.671283 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-6ca8e5e0-96d0-42e6-b5c0-872558db5af7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:45.671283 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:45.671283 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:45.671283 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:45.671283 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:45.671283 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:45.671283 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:45.671283 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:45.671283 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:45.671283 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:45.671283 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:45.671283 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:45.671283 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:52:45.671283 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:52:45.671283 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:52:45.672285 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:52:45.672285 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:45.672285 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:45.672285 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:45.672285 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:45.672285 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:45.672285 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:45.672285 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:45.672285 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:45.672285 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:45.672285 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:45.672285 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:45.672285 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:45.672285 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:45.672285 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:45.672285 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:45.672285 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:45.673206 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:52:45.673206 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:52:45.673206 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:45.673206 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:45.673206 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 339/693] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:52:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:52:45.678231 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca8e5e0-96d0-42e6-b5c0-872558db5af7 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:45.680823 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd74112-1d30-4dcf-b589-6b8e9b53b097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:45.681450 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd74112-1d30-4dcf-b589-6b8e9b53b097 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:45.681729 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd74112-1d30-4dcf-b589-6b8e9b53b097 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:45.682002 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd74112-1d30-4dcf-b589-6b8e9b53b097 None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:45.682805 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd74112-1d30-4dcf-b589-6b8e9b53b097 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:45.683114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd74112-1d30-4dcf-b589-6b8e9b53b097 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:45.684592 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd74112-1d30-4dcf-b589-6b8e9b53b097 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:45.721578 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 355/694] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Jul 27 18:52:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:45.727818 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd74112-1d30-4dcf-b589-6b8e9b53b097 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:45.818570 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca8e5e0-96d0-42e6-b5c0-872558db5af7 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:45.868431 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff1b99f-c321-4df3-98c0-9b5ed641a0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:45.869498 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff1b99f-c321-4df3-98c0-9b5ed641a0de None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:45.869973 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff1b99f-c321-4df3-98c0-9b5ed641a0de None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:45.870458 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff1b99f-c321-4df3-98c0-9b5ed641a0de None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:45.871451 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff1b99f-c321-4df3-98c0-9b5ed641a0de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:45.871998 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff1b99f-c321-4df3-98c0-9b5ed641a0de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:45.873693 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff1b99f-c321-4df3-98c0-9b5ed641a0de None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:45.888273 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:45.889635 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 340/695] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:52:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:45.891107 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5f898-3024-4b94-b633-783824b5ac8d None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:45.891714 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5f898-3024-4b94-b633-783824b5ac8d None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:45.893244 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5f898-3024-4b94-b633-783824b5ac8d None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:45.899513 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 341/696] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:52:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:52:45.899972 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd74112-1d30-4dcf-b589-6b8e9b53b097 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:45.901033 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5f898-3024-4b94-b633-783824b5ac8d None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:45.927274 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:45.939214 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67760ae-8c63-4806-bede-e5b3ef9b28e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:45.940034 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67760ae-8c63-4806-bede-e5b3ef9b28e6 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:45.940924 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67760ae-8c63-4806-bede-e5b3ef9b28e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:45.941298 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67760ae-8c63-4806-bede-e5b3ef9b28e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:46.012839 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5f898-3024-4b94-b633-783824b5ac8d None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:46.015159 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67760ae-8c63-4806-bede-e5b3ef9b28e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:46.016819 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67760ae-8c63-4806-bede-e5b3ef9b28e6 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:46.050001 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95076694-e7ba-4648-92b6-4039be4c713a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:46.050951 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95076694-e7ba-4648-92b6-4039be4c713a None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:46.051439 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95076694-e7ba-4648-92b6-4039be4c713a None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:46.051904 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95076694-e7ba-4648-92b6-4039be4c713a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:46.059226 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95076694-e7ba-4648-92b6-4039be4c713a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:46.061066 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95076694-e7ba-4648-92b6-4039be4c713a None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:46.073600 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-95076694-e7ba-4648-92b6-4039be4c713a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:52:46.073600 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:46.073600 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:46.073600 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:46.073600 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:46.073600 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:46.073600 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:46.073600 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:46.073600 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:46.073600 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:46.073600 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:46.073600 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:46.073600 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:52:46.073600 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:52:46.073600 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:52:46.074468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:52:46.074468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:46.074468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:46.074468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:46.074468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:46.074468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:46.074468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:46.074468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:46.074468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:46.074468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:46.074468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:46.074468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:46.074468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:46.074468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:46.074468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:46.074468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:46.074468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:46.075349 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:52:46.075349 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:52:46.075349 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:52:46.075349 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:52:46.075349 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:52:46.075349 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:52:46.075349 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:52:46.075349 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:46.078283 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 342/697] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 27 18:52:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:46.079770 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd31dc4-29cb-4800-a410-1ff50278d3e2 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:46.080225 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd31dc4-29cb-4800-a410-1ff50278d3e2 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:46.080775 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd31dc4-29cb-4800-a410-1ff50278d3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:46.100139 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-8bd31dc4-29cb-4800-a410-1ff50278d3e2 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:46.102725 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-8bd31dc4-29cb-4800-a410-1ff50278d3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:46.116422 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:46.127209 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 356/698] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 27 18:52:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:52:46.128245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67760ae-8c63-4806-bede-e5b3ef9b28e6 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:46.180095 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 343/699] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:52:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:52:46.181279 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd31dc4-29cb-4800-a410-1ff50278d3e2 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:46.207937 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:46.234046 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67760ae-8c63-4806-bede-e5b3ef9b28e6 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:46.274252 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebdafe8-203c-490e-a4e9-7a835e6419a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:46.275169 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebdafe8-203c-490e-a4e9-7a835e6419a6 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:46.275602 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebdafe8-203c-490e-a4e9-7a835e6419a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:46.276069 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebdafe8-203c-490e-a4e9-7a835e6419a6 None admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:46.276969 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebdafe8-203c-490e-a4e9-7a835e6419a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:46.277436 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebdafe8-203c-490e-a4e9-7a835e6419a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:46.278880 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebdafe8-203c-490e-a4e9-7a835e6419a6 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:46.291045 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 357/700] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 27 18:52:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:46.291885 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebdafe8-203c-490e-a4e9-7a835e6419a6 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:46.310034 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd31dc4-29cb-4800-a410-1ff50278d3e2 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:46.346295 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:46.348883 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c5acf-93ed-4024-9d5c-fb1ac656988a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:46.349589 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c5acf-93ed-4024-9d5c-fb1ac656988a None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:46.349911 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c5acf-93ed-4024-9d5c-fb1ac656988a None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:46.350241 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c5acf-93ed-4024-9d5c-fb1ac656988a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:46.360721 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030c5acf-93ed-4024-9d5c-fb1ac656988a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:46.362945 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030c5acf-93ed-4024-9d5c-fb1ac656988a None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:46.377699 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-030c5acf-93ed-4024-9d5c-fb1ac656988a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:46.377699 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:46.377699 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:46.377699 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:46.377699 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:46.377699 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:46.377699 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:46.377699 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:46.377699 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:46.377699 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:46.377699 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:46.377699 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:46.377699 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:52:46.377699 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:52:46.377699 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:52:46.378621 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:52:46.378621 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:46.378621 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:46.378621 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:46.378621 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:46.378621 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:46.378621 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:46.378621 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:46.378621 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:46.378621 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:46.378621 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:46.378621 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:46.378621 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:46.378621 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:46.378621 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:46.378621 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:46.378621 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:46.379536 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:52:46.379536 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:52:46.379536 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:46.379536 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:46.379536 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 344/701] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:52:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:46.380402 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772c767-c885-4fb1-8260-05f5bbcef25d None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:46.380402 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772c767-c885-4fb1-8260-05f5bbcef25d None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:46.380554 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772c767-c885-4fb1-8260-05f5bbcef25d None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:46.384904 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 345/702] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:52:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:52:46.384904 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3772c767-c885-4fb1-8260-05f5bbcef25d None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:46.409781 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebdafe8-203c-490e-a4e9-7a835e6419a6 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:46.447009 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e863609f-01cf-4313-acd6-db618ee75677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:46.447653 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863609f-01cf-4313-acd6-db618ee75677 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:46.447959 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863609f-01cf-4313-acd6-db618ee75677 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:46.448233 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863609f-01cf-4313-acd6-db618ee75677 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:46.448861 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e863609f-01cf-4313-acd6-db618ee75677 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:46.450212 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e863609f-01cf-4313-acd6-db618ee75677 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:46.453329 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:46.467139 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-e863609f-01cf-4313-acd6-db618ee75677 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 18:52:46.467139 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:46.467139 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:52:46.467139 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:52:46.467139 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:52:46.467139 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:52:46.467139 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:52:46.467139 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:52:46.467139 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 18:52:46.467139 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:46.467139 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:52:46.467139 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:46.467139 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:46.467139 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:46.467139 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:46.467139 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:46.468188 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:46.468188 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:46.468188 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:46.468188 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:46.468188 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:46.468188 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:46.468188 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:46.468188 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:52:46.468188 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:52:46.468188 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:52:46.468188 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:52:46.468188 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:46.468188 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:46.468188 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:46.468188 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:46.468188 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:46.469074 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:46.469074 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:46.469074 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:46.469074 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:46.469074 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:46.469074 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:46.469074 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:46.469074 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:46.469074 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:46.469074 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:46.469074 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:46.469074 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:52:46.469074 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:52:46.469074 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 18:52:46.469074 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:46.469874 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 358/703] 10.222.0.20 () {56 vars in 1129 bytes} [Wed Jul 27 18:52:46 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:46.469941 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e863609f-01cf-4313-acd6-db618ee75677 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:46.497545 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3772c767-c885-4fb1-8260-05f5bbcef25d None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:46.538241 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c1f8b-ef2c-4720-8915-a5cc64b3c488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:46.538899 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c1f8b-ef2c-4720-8915-a5cc64b3c488 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:46.539231 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c1f8b-ef2c-4720-8915-a5cc64b3c488 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:46.539484 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c1f8b-ef2c-4720-8915-a5cc64b3c488 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:46.540404 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c1f8b-ef2c-4720-8915-a5cc64b3c488 None admin] RBAC: Adding query filter params (role.id=306da3282d854292a7a53b8642ee373b, scope.project.id=31f027c53398443eb548eaf3f24523e0, user.id=16a9f1909ab3458c8c131986e303831a) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:46.540634 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c1f8b-ef2c-4720-8915-a5cc64b3c488 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:46.542039 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c1f8b-ef2c-4720-8915-a5cc64b3c488 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:46.548213 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 346/704] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 27 18:52:46 2022] GET /identity/v3/role_assignments?user.id=16a9f1909ab3458c8c131986e303831a&scope.project.id=31f027c53398443eb548eaf3f24523e0&role.id=306da3282d854292a7a53b8642ee373b => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:46.549228 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd33d17-4b89-43dd-b070-2bb1f8aa532a None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:46.549513 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd33d17-4b89-43dd-b070-2bb1f8aa532a None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:46.549785 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd33d17-4b89-43dd-b070-2bb1f8aa532a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:46.578238 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-7bd33d17-4b89-43dd-b070-2bb1f8aa532a None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:46.580022 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-7bd33d17-4b89-43dd-b070-2bb1f8aa532a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:46.605209 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e863609f-01cf-4313-acd6-db618ee75677 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:46.627560 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:46.652790 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e27f1-6509-437b-85cf-e44989ad5448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:46.653427 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e27f1-6509-437b-85cf-e44989ad5448 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:46.653713 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e27f1-6509-437b-85cf-e44989ad5448 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:46.653989 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e27f1-6509-437b-85cf-e44989ad5448 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:46.654699 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635e27f1-6509-437b-85cf-e44989ad5448 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:46.655008 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635e27f1-6509-437b-85cf-e44989ad5448 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:46.657108 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635e27f1-6509-437b-85cf-e44989ad5448 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:46.673146 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 347/705] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:52:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:52:46.674351 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd33d17-4b89-43dd-b070-2bb1f8aa532a None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:46.686037 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 359/706] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:52:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:46.687323 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e27f1-6509-437b-85cf-e44989ad5448 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:46.778152 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:46.830842 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd33d17-4b89-43dd-b070-2bb1f8aa532a None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:46.852533 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e27f1-6509-437b-85cf-e44989ad5448 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:46.880210 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d0d35-4a0e-485c-a213-7bd933430459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:46.880833 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d0d35-4a0e-485c-a213-7bd933430459 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:46.881120 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d0d35-4a0e-485c-a213-7bd933430459 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:46.881395 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d0d35-4a0e-485c-a213-7bd933430459 None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:46.882335 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21d0d35-4a0e-485c-a213-7bd933430459 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:46.882648 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21d0d35-4a0e-485c-a213-7bd933430459 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:46.885504 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21d0d35-4a0e-485c-a213-7bd933430459 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:46.891394 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 348/707] 10.222.0.20 () {56 vars in 1124 bytes} [Wed Jul 27 18:52:46 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:46.895710 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d0d35-4a0e-485c-a213-7bd933430459 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:46.897187 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d15cf-0505-4378-aa1f-1a57a6b14774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:46.897837 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d15cf-0505-4378-aa1f-1a57a6b14774 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:46.898120 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d15cf-0505-4378-aa1f-1a57a6b14774 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:46.898429 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d15cf-0505-4378-aa1f-1a57a6b14774 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:46.908036 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d15cf-0505-4378-aa1f-1a57a6b14774 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:46.909957 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d15cf-0505-4378-aa1f-1a57a6b14774 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:46.926306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-323d15cf-0505-4378-aa1f-1a57a6b14774 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:52:46.926306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:46.926306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:46.926306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:46.926306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:46.926306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:46.926306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:46.926306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:46.926306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:46.926306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:46.926306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:46.926306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:46.926306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:52:46.926306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:52:46.926306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:52:46.927255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:52:46.927255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:46.927255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:46.927255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:46.927255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:46.927255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:46.927255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:46.927255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:46.927255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:46.927255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:46.927255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:46.927255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:46.927255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:46.927255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:46.927255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:46.927255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:46.927255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:46.928174 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:52:46.928174 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:52:46.928174 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:52:46.928174 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:52:46.928174 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:52:46.928174 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:52:46.928174 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:52:46.928174 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:46.928174 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 360/708] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 27 18:52:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:46.928664 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d15cf-0505-4378-aa1f-1a57a6b14774 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:46.976184 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:47.025861 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d0d35-4a0e-485c-a213-7bd933430459 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:47.050821 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:47.064044 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eaff05-8294-4946-a95c-cb19be960071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:47.064788 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eaff05-8294-4946-a95c-cb19be960071 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:47.065079 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eaff05-8294-4946-a95c-cb19be960071 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:47.065358 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eaff05-8294-4946-a95c-cb19be960071 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:47.066535 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d15cf-0505-4378-aa1f-1a57a6b14774 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:47.076991 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eaff05-8294-4946-a95c-cb19be960071 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:47.078496 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eaff05-8294-4946-a95c-cb19be960071 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:47.095004 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-b4eaff05-8294-4946-a95c-cb19be960071 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:47.095004 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:47.095004 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:47.095004 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:47.095004 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:47.095004 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:47.095004 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:47.095004 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:47.095004 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:47.095004 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:47.095004 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:47.095004 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:47.095004 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:52:47.095004 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:52:47.095004 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:52:47.095949 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:52:47.095949 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:47.095949 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:47.095949 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:47.095949 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:47.095949 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:47.095949 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:47.095949 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:47.095949 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:47.095949 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:47.095949 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:47.095949 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:47.095949 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:47.095949 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:47.095949 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:47.095949 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:47.095949 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:47.096847 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:52:47.096847 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:52:47.096847 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:47.096847 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:47.096847 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 349/709] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:52:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:47.097546 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eaff05-8294-4946-a95c-cb19be960071 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:47.113006 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96572e1-cc15-4493-b9ab-d7e8e650f17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:47.114352 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96572e1-cc15-4493-b9ab-d7e8e650f17c None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:47.114832 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96572e1-cc15-4493-b9ab-d7e8e650f17c None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:47.115453 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96572e1-cc15-4493-b9ab-d7e8e650f17c None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:47.116451 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96572e1-cc15-4493-b9ab-d7e8e650f17c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:47.117445 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96572e1-cc15-4493-b9ab-d7e8e650f17c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:47.119709 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96572e1-cc15-4493-b9ab-d7e8e650f17c None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:47.132462 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 361/710] 10.222.0.20 () {56 vars in 1124 bytes} [Wed Jul 27 18:52:46 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:47.133399 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96572e1-cc15-4493-b9ab-d7e8e650f17c None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:47.256769 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eaff05-8294-4946-a95c-cb19be960071 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:47.303944 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f285733-3eba-4927-8445-80a052dc79e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:47.305552 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f285733-3eba-4927-8445-80a052dc79e5 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:47.305833 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f285733-3eba-4927-8445-80a052dc79e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:47.306373 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f285733-3eba-4927-8445-80a052dc79e5 None admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:47.307180 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f285733-3eba-4927-8445-80a052dc79e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:47.307722 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f285733-3eba-4927-8445-80a052dc79e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:47.308626 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:47.310842 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f285733-3eba-4927-8445-80a052dc79e5 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:47.311797 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96572e1-cc15-4493-b9ab-d7e8e650f17c None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:47.328455 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 350/711] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 27 18:52:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:47.329644 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10d839-bad1-46da-9ec2-6cbc621eab51 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:47.329936 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10d839-bad1-46da-9ec2-6cbc621eab51 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:47.330210 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10d839-bad1-46da-9ec2-6cbc621eab51 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:47.335593 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 351/712] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:52:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:52:47.336506 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e10d839-bad1-46da-9ec2-6cbc621eab51 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:47.350128 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e0850a-6667-4058-a9e3-a8bbd375a8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:47.350701 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0850a-6667-4058-a9e3-a8bbd375a8a4 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:47.350981 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0850a-6667-4058-a9e3-a8bbd375a8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:47.351250 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0850a-6667-4058-a9e3-a8bbd375a8a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:47.352011 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e0850a-6667-4058-a9e3-a8bbd375a8a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:47.352314 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e0850a-6667-4058-a9e3-a8bbd375a8a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:47.353666 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e0850a-6667-4058-a9e3-a8bbd375a8a4 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:47.366907 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 362/713] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:52:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:47.368522 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57676663-7022-4444-8ff9-320b9eff69a4 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:47.368812 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57676663-7022-4444-8ff9-320b9eff69a4 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:47.369093 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57676663-7022-4444-8ff9-320b9eff69a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:47.384534 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:47.394656 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-57676663-7022-4444-8ff9-320b9eff69a4 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:47.397036 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-57676663-7022-4444-8ff9-320b9eff69a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:47.477440 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e10d839-bad1-46da-9ec2-6cbc621eab51 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:47.484480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 363/714] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:52:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:52:47.485714 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57676663-7022-4444-8ff9-320b9eff69a4 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:47.534694 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94001e9-88c7-4588-bf3e-2b1d70b86657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:47.535323 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94001e9-88c7-4588-bf3e-2b1d70b86657 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:47.535602 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94001e9-88c7-4588-bf3e-2b1d70b86657 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:47.535894 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94001e9-88c7-4588-bf3e-2b1d70b86657 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:47.536694 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94001e9-88c7-4588-bf3e-2b1d70b86657 None admin] RBAC: Adding query filter params (role.id=0f4a39b061e148418413cfe647af9a34, scope.project.id=31f027c53398443eb548eaf3f24523e0, user.id=17fbef9db7734283aaad4962ee160171) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:47.537007 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94001e9-88c7-4588-bf3e-2b1d70b86657 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:47.538434 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94001e9-88c7-4588-bf3e-2b1d70b86657 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:47.547745 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 352/715] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 27 18:52:47 2022] GET /identity/v3/role_assignments?user.id=17fbef9db7734283aaad4962ee160171&scope.project.id=31f027c53398443eb548eaf3f24523e0&role.id=0f4a39b061e148418413cfe647af9a34 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:47.547745 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94001e9-88c7-4588-bf3e-2b1d70b86657 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:47.690856 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:47.705945 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57676663-7022-4444-8ff9-320b9eff69a4 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:47.746689 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94a0dd-22a3-440c-8c3a-a0c5d48429df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:47.746907 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:47.747716 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94a0dd-22a3-440c-8c3a-a0c5d48429df None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:47.748139 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94a0dd-22a3-440c-8c3a-a0c5d48429df None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:47.748558 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94a0dd-22a3-440c-8c3a-a0c5d48429df None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:47.749389 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d94a0dd-22a3-440c-8c3a-a0c5d48429df None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:47.750969 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d94a0dd-22a3-440c-8c3a-a0c5d48429df None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:47.751124 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94001e9-88c7-4588-bf3e-2b1d70b86657 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:47.776464 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 364/716] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Jul 27 18:52:47 2022] POST /identity/v3/users => generated 254 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:52:47.828433 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba602fe-a6f5-496d-8a7b-c91dfa0d4d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:47.829088 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba602fe-a6f5-496d-8a7b-c91dfa0d4d1b None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:47.829368 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba602fe-a6f5-496d-8a7b-c91dfa0d4d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:47.830198 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba602fe-a6f5-496d-8a7b-c91dfa0d4d1b None admin] PATH_INFO: `/v3/services/network` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:47.830294 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba602fe-a6f5-496d-8a7b-c91dfa0d4d1b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:47.831668 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba602fe-a6f5-496d-8a7b-c91dfa0d4d1b None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:47.846020 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-fba602fe-a6f5-496d-8a7b-c91dfa0d4d1b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 18:52:47.846020 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:47.846020 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:52:47.846020 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:52:47.846020 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:52:47.846020 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:52:47.846020 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:52:47.846020 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:52:47.846020 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 18:52:47.846020 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:47.846020 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:52:47.846020 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:47.846020 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:47.846020 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:47.846020 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:47.846020 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:47.846020 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:47.847041 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:47.847041 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:47.847041 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:47.847041 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:47.847041 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:47.847041 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:47.847041 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:52:47.847041 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:52:47.847041 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:52:47.847041 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:52:47.847041 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:47.847041 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:47.847041 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:47.847041 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:47.847041 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:47.847041 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:47.847950 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:47.847950 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:47.847950 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:47.847950 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:47.847950 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:47.847950 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:47.847950 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:47.847950 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:47.847950 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:47.847950 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:47.847950 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:52:47.847950 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:52:47.847950 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 18:52:47.847950 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:47.847950 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 353/717] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 27 18:52:47 2022] GET /identity/v3/services/network => generated 88 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:47.855827 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94a0dd-22a3-440c-8c3a-a0c5d48429df None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:47.990705 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94a0dd-22a3-440c-8c3a-a0c5d48429df None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:48.026632 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f8066-a789-4541-9c05-2b1d4b395dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:48.027616 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f8066-a789-4541-9c05-2b1d4b395dcb None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:48.028131 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f8066-a789-4541-9c05-2b1d4b395dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:48.028607 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f8066-a789-4541-9c05-2b1d4b395dcb None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:48.029497 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0f8066-a789-4541-9c05-2b1d4b395dcb None admin] RBAC: Adding query filter params (name=network) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:48.030026 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0f8066-a789-4541-9c05-2b1d4b395dcb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:48.031589 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0f8066-a789-4541-9c05-2b1d4b395dcb None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:48.036850 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 365/718] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Jul 27 18:52:47 2022] GET /identity/v3/services?name=network => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:48.042630 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba602fe-a6f5-496d-8a7b-c91dfa0d4d1b None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:48.152070 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba602fe-a6f5-496d-8a7b-c91dfa0d4d1b None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:48.187080 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b11036-5552-48b2-a1ad-e2740fef0337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:48.188052 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b11036-5552-48b2-a1ad-e2740fef0337 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:48.188541 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b11036-5552-48b2-a1ad-e2740fef0337 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:48.189068 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b11036-5552-48b2-a1ad-e2740fef0337 None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:48.189959 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b11036-5552-48b2-a1ad-e2740fef0337 None admin] RBAC: Adding query filter params (type=network) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:48.190478 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b11036-5552-48b2-a1ad-e2740fef0337 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:48.192088 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b11036-5552-48b2-a1ad-e2740fef0337 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:48.198581 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 354/719] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Jul 27 18:52:48 2022] GET /identity/v3/services?type=network => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:48.887555 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b71b678-ce70-49af-b1dc-8cbfe8ec4cb2 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:48.888627 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b71b678-ce70-49af-b1dc-8cbfe8ec4cb2 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:48.889123 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b71b678-ce70-49af-b1dc-8cbfe8ec4cb2 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:48.891110 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 366/720] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:52:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:52:48.896569 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57529fe-4167-40ec-8d3c-1fa302b4f2e9 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:48.897061 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57529fe-4167-40ec-8d3c-1fa302b4f2e9 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:48.897138 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57529fe-4167-40ec-8d3c-1fa302b4f2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:48.925083 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-c57529fe-4167-40ec-8d3c-1fa302b4f2e9 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:48.926262 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-c57529fe-4167-40ec-8d3c-1fa302b4f2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:48.953352 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:49.025469 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 355/721] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:52:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:52:49.059064 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b71b678-ce70-49af-b1dc-8cbfe8ec4cb2 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:49.075114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:49.196933 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b71b678-ce70-49af-b1dc-8cbfe8ec4cb2 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:49.240610 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3347c96-cc77-4209-89f6-5092173e1a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:49.244940 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3347c96-cc77-4209-89f6-5092173e1a1e None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:49.245225 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3347c96-cc77-4209-89f6-5092173e1a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:49.246305 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3347c96-cc77-4209-89f6-5092173e1a1e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:49.264652 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3347c96-cc77-4209-89f6-5092173e1a1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:52:49.271368 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-a3347c96-cc77-4209-89f6-5092173e1a1e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:52:49.271368 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:49.271368 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:49.271368 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:49.271368 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:49.271368 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:49.271368 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:49.271368 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:49.271368 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:49.271368 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:49.271368 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:49.271368 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:49.271368 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:52:49.271368 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:52:49.271368 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:52:49.271368 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:52:49.272428 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:52:49.272428 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:52:49.272428 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:52:49.272428 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:52:49.272428 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:49.272428 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:49.272428 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:49.272428 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:49.272428 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:49.272428 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:49.272428 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:49.272428 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:49.272428 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:49.272428 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:49.272428 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:49.272428 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:49.273290 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:49.273290 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:49.273290 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:49.273290 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:49.273290 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:52:49.273290 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:52:49.273290 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:52:49.273290 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:52:49.273290 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:52:49.273290 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:52:49.273290 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:52:49.273290 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:49.278426 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57529fe-4167-40ec-8d3c-1fa302b4f2e9 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:49.280417 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 367/722] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 27 18:52:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:49.378730 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57529fe-4167-40ec-8d3c-1fa302b4f2e9 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:49.446611 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44164dd7-a053-4783-a509-a0c88ac0673f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:49.447729 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44164dd7-a053-4783-a509-a0c88ac0673f None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:49.448158 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44164dd7-a053-4783-a509-a0c88ac0673f None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:49.448635 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44164dd7-a053-4783-a509-a0c88ac0673f None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:49.449921 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44164dd7-a053-4783-a509-a0c88ac0673f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:49.450467 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44164dd7-a053-4783-a509-a0c88ac0673f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:49.452976 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44164dd7-a053-4783-a509-a0c88ac0673f None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:49.468678 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 356/723] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 27 18:52:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:49.473830 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3347c96-cc77-4209-89f6-5092173e1a1e None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:49.612710 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:49.625520 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d51cf-85db-4006-a443-ca8b32e5ec16 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:49.625813 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d51cf-85db-4006-a443-ca8b32e5ec16 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:49.626232 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d51cf-85db-4006-a443-ca8b32e5ec16 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:49.627842 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 357/724] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:52:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:52:49.635719 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61435cdd-7f89-49a6-b130-68c30cde6894 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:49.635719 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61435cdd-7f89-49a6-b130-68c30cde6894 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:49.635719 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61435cdd-7f89-49a6-b130-68c30cde6894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:49.692062 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3347c96-cc77-4209-89f6-5092173e1a1e None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:49.791422 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-61435cdd-7f89-49a6-b130-68c30cde6894 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:49.792538 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-61435cdd-7f89-49a6-b130-68c30cde6894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:49.795435 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76dd6e-64fa-42ea-9f75-c749291fe487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:49.796117 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76dd6e-64fa-42ea-9f75-c749291fe487 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:49.796398 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76dd6e-64fa-42ea-9f75-c749291fe487 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:49.796671 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76dd6e-64fa-42ea-9f75-c749291fe487 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:49.813921 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b76dd6e-64fa-42ea-9f75-c749291fe487 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:49.815365 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b76dd6e-64fa-42ea-9f75-c749291fe487 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:49.827608 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:49.842772 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-6b76dd6e-64fa-42ea-9f75-c749291fe487 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:49.842772 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:49.842772 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:49.842772 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:49.842772 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:49.842772 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:49.842772 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:49.842772 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:49.842772 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:49.842772 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:49.842772 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:49.842772 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:49.842772 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:52:49.842772 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:52:49.842772 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:52:49.843790 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:52:49.843790 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:49.843790 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:49.843790 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:49.843790 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:49.843790 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:49.843790 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:49.843790 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:49.843790 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:49.843790 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:49.843790 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:49.843790 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:49.843790 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:49.843790 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:49.843790 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:49.843790 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:49.843790 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:49.844670 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:52:49.844670 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:52:49.844670 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:49.844670 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:49.844670 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 368/725] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:52:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:49.849780 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76dd6e-64fa-42ea-9f75-c749291fe487 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:49.968176 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76dd6e-64fa-42ea-9f75-c749291fe487 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:49.991337 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 358/726] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:52:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:52:50.015300 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040e39f-1ee8-4942-8ea5-5d239a3035bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:50.016205 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040e39f-1ee8-4942-8ea5-5d239a3035bc None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:50.016638 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040e39f-1ee8-4942-8ea5-5d239a3035bc None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:50.017277 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040e39f-1ee8-4942-8ea5-5d239a3035bc None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:50.018141 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2040e39f-1ee8-4942-8ea5-5d239a3035bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:50.018602 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2040e39f-1ee8-4942-8ea5-5d239a3035bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:50.020247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2040e39f-1ee8-4942-8ea5-5d239a3035bc None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:50.028004 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:50.034072 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61435cdd-7f89-49a6-b130-68c30cde6894 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:50.050078 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 369/727] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:52:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:52:50.073063 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040e39f-1ee8-4942-8ea5-5d239a3035bc None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:50.191856 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61435cdd-7f89-49a6-b130-68c30cde6894 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:50.228706 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66020924-7473-4ff9-95b2-2902b8afe7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:50.229717 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66020924-7473-4ff9-95b2-2902b8afe7c5 None admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:50.230064 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66020924-7473-4ff9-95b2-2902b8afe7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:50.230403 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66020924-7473-4ff9-95b2-2902b8afe7c5 None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:50.231362 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66020924-7473-4ff9-95b2-2902b8afe7c5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:50.232841 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66020924-7473-4ff9-95b2-2902b8afe7c5 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:50.259439 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 359/728] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Jul 27 18:52:50 2022] POST /identity/v3/services => generated 251 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:52:50.260802 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a79c3-f183-47af-976d-f658e1988443 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:50.261140 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a79c3-f183-47af-976d-f658e1988443 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:50.261421 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a79c3-f183-47af-976d-f658e1988443 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:50.263263 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 360/729] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:52:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:52:50.268840 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55723c9d-ddbd-4ab4-98b6-92b531d3c37b None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:50.269150 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55723c9d-ddbd-4ab4-98b6-92b531d3c37b None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:50.269393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55723c9d-ddbd-4ab4-98b6-92b531d3c37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:50.275009 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040e39f-1ee8-4942-8ea5-5d239a3035bc None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:50.307315 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-55723c9d-ddbd-4ab4-98b6-92b531d3c37b None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:50.307555 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-55723c9d-ddbd-4ab4-98b6-92b531d3c37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:50.312121 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:50.370998 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b98f30-471c-498d-8c34-72aff5736668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:50.371652 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b98f30-471c-498d-8c34-72aff5736668 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:50.371963 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b98f30-471c-498d-8c34-72aff5736668 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:50.372237 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b98f30-471c-498d-8c34-72aff5736668 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:50.380767 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b98f30-471c-498d-8c34-72aff5736668 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:50.382357 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b98f30-471c-498d-8c34-72aff5736668 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:50.395022 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-c4b98f30-471c-498d-8c34-72aff5736668 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 18:52:50.395022 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:50.395022 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:50.395022 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:50.395022 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:50.395022 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:50.395022 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:50.395022 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:50.395022 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:50.395022 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:50.395022 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:50.395022 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:50.395022 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:52:50.395022 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:52:50.395022 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:52:50.395022 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:52:50.396089 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:50.396089 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:50.396089 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:52:50.396089 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:52:50.396089 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:52:50.396089 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:52:50.396089 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:50.396089 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:50.396089 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:50.396089 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:50.396089 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:50.396089 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:50.396089 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:50.396089 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:50.396089 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:50.396089 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:50.396089 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:50.396089 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:50.397043 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:50.397043 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:50.397043 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:52:50.397043 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:52:50.397043 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:52:50.397043 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:52:50.397043 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:52:50.397043 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:52:50.397043 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 18:52:50.397043 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:50.401603 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 370/730] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 27 18:52:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:52:50.402952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b98f30-471c-498d-8c34-72aff5736668 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:50.448236 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 361/731] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:52:50 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:52:50.468039 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:50.475051 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55723c9d-ddbd-4ab4-98b6-92b531d3c37b None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:50.580072 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b98f30-471c-498d-8c34-72aff5736668 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:50.598869 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55723c9d-ddbd-4ab4-98b6-92b531d3c37b None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:50.617525 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e5385-e967-482a-ad3e-a198c351000b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:50.618177 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e5385-e967-482a-ad3e-a198c351000b None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:50.618462 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e5385-e967-482a-ad3e-a198c351000b None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:50.618826 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e5385-e967-482a-ad3e-a198c351000b None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:50.619540 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e5385-e967-482a-ad3e-a198c351000b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:50.619881 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e5385-e967-482a-ad3e-a198c351000b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:50.621302 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e5385-e967-482a-ad3e-a198c351000b None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:50.638559 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e99793a-bdca-43ec-9d84-541b49a75b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:50.639538 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99793a-bdca-43ec-9d84-541b49a75b2b None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:50.640058 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99793a-bdca-43ec-9d84-541b49a75b2b None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:50.640553 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99793a-bdca-43ec-9d84-541b49a75b2b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:50.643955 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 371/732] 10.222.0.20 () {56 vars in 1135 bytes} [Wed Jul 27 18:52:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:52:50.645451 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e5385-e967-482a-ad3e-a198c351000b None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:50.649360 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:50.654429 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e99793a-bdca-43ec-9d84-541b49a75b2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:52:50.660519 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-3e99793a-bdca-43ec-9d84-541b49a75b2b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:52:50.660519 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:50.660519 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:50.660519 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:50.660519 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:50.660519 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:50.660519 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:50.660519 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:50.660519 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:50.660519 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:50.660519 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:50.660519 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:50.660519 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:52:50.660519 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:52:50.660519 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:52:50.660519 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:52:50.661639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:52:50.661639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:52:50.661639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:52:50.661639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:52:50.661639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:50.661639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:50.661639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:50.661639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:50.661639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:50.661639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:50.661639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:50.661639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:50.661639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:50.661639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:50.661639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:50.661639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:50.662539 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:50.662539 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:50.662539 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:50.662539 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:50.662539 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:52:50.662539 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:52:50.662539 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:52:50.662539 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:52:50.662539 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:52:50.662539 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:52:50.662539 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:52:50.662539 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:50.666705 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 362/733] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 27 18:52:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:52:50.672823 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e99793a-bdca-43ec-9d84-541b49a75b2b None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:50.744473 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:50.750453 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e5385-e967-482a-ad3e-a198c351000b None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:50.783344 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e99793a-bdca-43ec-9d84-541b49a75b2b None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:50.790983 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6131b6-da0f-47e9-b2d9-f0f1a2b36a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:50.791617 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6131b6-da0f-47e9-b2d9-f0f1a2b36a3a None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:50.791957 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6131b6-da0f-47e9-b2d9-f0f1a2b36a3a None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:50.792234 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6131b6-da0f-47e9-b2d9-f0f1a2b36a3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:50.818338 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c76684-ca1c-4d39-8de2-4631319de67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:50.819221 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c76684-ca1c-4d39-8de2-4631319de67c None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:50.819702 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c76684-ca1c-4d39-8de2-4631319de67c None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:50.820689 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c76684-ca1c-4d39-8de2-4631319de67c None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:50.821579 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c76684-ca1c-4d39-8de2-4631319de67c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:50.822081 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c76684-ca1c-4d39-8de2-4631319de67c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:50.823588 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c76684-ca1c-4d39-8de2-4631319de67c None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:50.837587 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 363/734] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 27 18:52:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:50.837587 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324832bc-1576-407c-901f-ac577f3491f9 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:50.837587 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324832bc-1576-407c-901f-ac577f3491f9 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:50.837587 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324832bc-1576-407c-901f-ac577f3491f9 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:50.837587 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 364/735] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:52:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:52:50.837587 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b4a950-8f0d-4124-9f76-517018598767 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:50.838029 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b4a950-8f0d-4124-9f76-517018598767 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:50.838029 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b4a950-8f0d-4124-9f76-517018598767 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:50.840294 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 365/736] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:52:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:52:50.840294 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b4a950-8f0d-4124-9f76-517018598767 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:50.871483 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6131b6-da0f-47e9-b2d9-f0f1a2b36a3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:50.872978 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6131b6-da0f-47e9-b2d9-f0f1a2b36a3a None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:50.905359 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:50.951243 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b4a950-8f0d-4124-9f76-517018598767 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:50.970442 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:50.977745 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 372/737] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 27 18:52:50 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:52:50.979003 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388702b1-e80c-4c33-bba1-a314da790c88 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:50.979293 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388702b1-e80c-4c33-bba1-a314da790c88 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:50.979570 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388702b1-e80c-4c33-bba1-a314da790c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:50.993367 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a6016-3411-490a-a34d-5525aa335d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:50.994005 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a6016-3411-490a-a34d-5525aa335d75 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:50.994283 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a6016-3411-490a-a34d-5525aa335d75 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:50.994554 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a6016-3411-490a-a34d-5525aa335d75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:50.998158 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-388702b1-e80c-4c33-bba1-a314da790c88 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:50.999327 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-388702b1-e80c-4c33-bba1-a314da790c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:51.004990 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a6016-3411-490a-a34d-5525aa335d75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:51.006405 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a6016-3411-490a-a34d-5525aa335d75 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:51.020745 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-ce8a6016-3411-490a-a34d-5525aa335d75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:51.020745 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:51.020745 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:51.020745 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:51.020745 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:51.020745 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:51.020745 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:51.020745 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:51.020745 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:51.020745 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:51.020745 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:51.020745 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:51.020745 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:52:51.020745 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:52:51.020745 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:52:51.021665 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:52:51.021665 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:51.021665 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:51.021665 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:51.021665 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:51.021665 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:51.021665 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:51.021665 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:51.021665 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:51.021665 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:51.021665 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:51.021665 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:51.021665 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:51.021665 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:51.021665 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:51.021665 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:51.021665 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:51.022538 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:52:51.022538 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:52:51.022538 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:51.022538 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:51.022538 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 366/738] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:52:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:51.023776 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef51981-1f9a-42bb-ba3c-1abf231c858c None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:51.023943 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef51981-1f9a-42bb-ba3c-1abf231c858c None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:51.024195 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef51981-1f9a-42bb-ba3c-1abf231c858c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:51.041635 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-7ef51981-1f9a-42bb-ba3c-1abf231c858c None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:51.042812 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-7ef51981-1f9a-42bb-ba3c-1abf231c858c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:51.074713 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 373/739] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:52:50 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:52:51.075902 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388702b1-e80c-4c33-bba1-a314da790c88 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:51.118885 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 367/740] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:52:51 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:52:51.119660 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef51981-1f9a-42bb-ba3c-1abf231c858c None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:51.163065 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:51.207596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388702b1-e80c-4c33-bba1-a314da790c88 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:51.221628 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef51981-1f9a-42bb-ba3c-1abf231c858c None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:51.236547 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:51.246893 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce6f8ce-9efd-4042-bc19-43d6a2093538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:51.247533 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6f8ce-9efd-4042-bc19-43d6a2093538 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:51.247859 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6f8ce-9efd-4042-bc19-43d6a2093538 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:51.248133 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6f8ce-9efd-4042-bc19-43d6a2093538 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:51.258572 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce6f8ce-9efd-4042-bc19-43d6a2093538 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:51.259241 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6db5f9-5c70-4a6c-bc1a-3a190a05d529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:51.260006 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce6f8ce-9efd-4042-bc19-43d6a2093538 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:51.260300 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6db5f9-5c70-4a6c-bc1a-3a190a05d529 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:51.260756 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6db5f9-5c70-4a6c-bc1a-3a190a05d529 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:51.261203 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6db5f9-5c70-4a6c-bc1a-3a190a05d529 None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:51.262238 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6db5f9-5c70-4a6c-bc1a-3a190a05d529 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:51.262965 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6db5f9-5c70-4a6c-bc1a-3a190a05d529 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:51.264514 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6db5f9-5c70-4a6c-bc1a-3a190a05d529 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:51.274346 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-dce6f8ce-9efd-4042-bc19-43d6a2093538 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:51.274346 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:51.274346 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:51.274346 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:51.274346 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:51.274346 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:51.274346 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:51.274346 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:51.274346 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:51.274346 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:51.274346 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:51.274346 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:51.274346 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:52:51.274346 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:52:51.274346 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:52:51.275387 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:52:51.275387 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:51.275387 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:51.275387 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:51.275387 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:51.275387 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:51.275387 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:51.275387 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:51.275387 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:51.275387 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:51.275387 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:51.275387 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:51.275387 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:51.275387 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:51.275387 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:51.275387 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:51.275387 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:51.276357 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:52:51.276357 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:52:51.276357 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:51.276357 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:51.276357 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 374/741] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:52:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:51.276638 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce6f8ce-9efd-4042-bc19-43d6a2093538 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:51.282788 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 368/742] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:52:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:51.284511 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6db5f9-5c70-4a6c-bc1a-3a190a05d529 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:51.382242 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce6f8ce-9efd-4042-bc19-43d6a2093538 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:51.400116 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6db5f9-5c70-4a6c-bc1a-3a190a05d529 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:51.401944 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:51.419097 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64f113-df41-4e5f-a6ff-75e33196f190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:51.419750 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64f113-df41-4e5f-a6ff-75e33196f190 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:51.420030 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64f113-df41-4e5f-a6ff-75e33196f190 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:51.420296 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64f113-df41-4e5f-a6ff-75e33196f190 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:51.431510 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b64f113-df41-4e5f-a6ff-75e33196f190 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:52:51.436445 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee77ffe4-dce3-4e77-a53d-293fe0e5bf63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:51.436956 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-9b64f113-df41-4e5f-a6ff-75e33196f190 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:52:51.436956 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:51.436956 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:51.436956 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:51.436956 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:51.436956 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:51.436956 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:51.436956 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:51.436956 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:51.436956 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:51.436956 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:51.436956 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:51.436956 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:52:51.436956 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:52:51.436956 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:52:51.436956 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:52:51.437865 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:52:51.437865 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:52:51.437865 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:52:51.437865 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:52:51.437865 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:51.437865 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:51.437865 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:51.437865 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:51.437865 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:51.437865 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:51.437865 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:51.437865 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:51.437865 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:51.437865 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:51.437865 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:51.437865 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:51.443751 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:51.443751 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:51.443751 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:51.443751 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:51.443751 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:52:51.443751 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:52:51.443751 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:52:51.443751 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:52:51.443751 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:52:51.443751 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:52:51.443751 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:52:51.443751 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:51.444398 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77ffe4-dce3-4e77-a53d-293fe0e5bf63 None admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:51.444398 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77ffe4-dce3-4e77-a53d-293fe0e5bf63 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:51.444398 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77ffe4-dce3-4e77-a53d-293fe0e5bf63 None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:51.444398 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee77ffe4-dce3-4e77-a53d-293fe0e5bf63 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:51.444647 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 375/743] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 27 18:52:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:51.444647 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64f113-df41-4e5f-a6ff-75e33196f190 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:51.444785 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee77ffe4-dce3-4e77-a53d-293fe0e5bf63 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:51.457280 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 369/744] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Jul 27 18:52:51 2022] POST /identity/v3/services => generated 240 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:52:51.469958 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee77ffe4-dce3-4e77-a53d-293fe0e5bf63 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:51.491041 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:51.581297 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64f113-df41-4e5f-a6ff-75e33196f190 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:51.626322 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee77ffe4-dce3-4e77-a53d-293fe0e5bf63 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:51.627867 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fed2de-8b92-4c3b-b420-9141b6dda2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:51.628515 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fed2de-8b92-4c3b-b420-9141b6dda2f6 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:51.628765 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fed2de-8b92-4c3b-b420-9141b6dda2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:51.629036 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fed2de-8b92-4c3b-b420-9141b6dda2f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:51.629787 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fed2de-8b92-4c3b-b420-9141b6dda2f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:51.630099 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fed2de-8b92-4c3b-b420-9141b6dda2f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:51.631469 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fed2de-8b92-4c3b-b420-9141b6dda2f6 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:51.646679 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 376/745] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:52:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:51.647459 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fed2de-8b92-4c3b-b420-9141b6dda2f6 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:51.668732 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230bb49-d557-4ffe-b411-5580969f34a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:51.668732 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230bb49-d557-4ffe-b411-5580969f34a3 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:51.668999 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230bb49-d557-4ffe-b411-5580969f34a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:51.669259 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230bb49-d557-4ffe-b411-5580969f34a3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:51.678919 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0230bb49-d557-4ffe-b411-5580969f34a3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:51.681203 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0230bb49-d557-4ffe-b411-5580969f34a3 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:51.692995 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-0230bb49-d557-4ffe-b411-5580969f34a3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 18:52:51.692995 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:51.692995 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:51.692995 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:51.692995 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:51.692995 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:51.692995 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:51.692995 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:51.692995 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:51.692995 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:51.692995 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:51.692995 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:51.692995 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:52:51.692995 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:52:51.692995 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:52:51.692995 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:52:51.693939 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:51.693939 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:51.693939 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:52:51.693939 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:52:51.693939 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:52:51.693939 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:52:51.693939 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:51.693939 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:51.693939 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:51.693939 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:51.693939 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:51.693939 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:51.693939 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:51.693939 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:51.693939 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:51.693939 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:51.693939 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:51.693939 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:51.694881 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:51.694881 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:51.694881 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:52:51.694881 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:52:51.694881 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:52:51.694881 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:52:51.694881 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:52:51.694881 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:52:51.694881 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 18:52:51.694881 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:51.702268 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 370/746] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Jul 27 18:52:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:51.703289 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230bb49-d557-4ffe-b411-5580969f34a3 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:51.729879 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:51.762894 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:51.771750 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fed2de-8b92-4c3b-b420-9141b6dda2f6 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:51.814450 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0fb147-5291-43eb-958f-708dfa74f066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:51.815187 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0fb147-5291-43eb-958f-708dfa74f066 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:51.815469 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0fb147-5291-43eb-958f-708dfa74f066 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:51.815765 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0fb147-5291-43eb-958f-708dfa74f066 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:51.816911 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0fb147-5291-43eb-958f-708dfa74f066 None admin] RBAC: Adding query filter params (name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:51.817228 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0fb147-5291-43eb-958f-708dfa74f066 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:51.818881 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0fb147-5291-43eb-958f-708dfa74f066 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:51.819758 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230bb49-d557-4ffe-b411-5580969f34a3 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:51.831788 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 377/747] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Jul 27 18:52:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:51.832698 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0fb147-5291-43eb-958f-708dfa74f066 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:51.861308 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809594f-aa4f-43c4-9edd-c0aab3fc732e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:51.861950 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809594f-aa4f-43c4-9edd-c0aab3fc732e None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:51.862444 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809594f-aa4f-43c4-9edd-c0aab3fc732e None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:51.862725 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809594f-aa4f-43c4-9edd-c0aab3fc732e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:51.870562 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1809594f-aa4f-43c4-9edd-c0aab3fc732e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:51.872067 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1809594f-aa4f-43c4-9edd-c0aab3fc732e None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:51.884255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-1809594f-aa4f-43c4-9edd-c0aab3fc732e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:52:51.884255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:51.884255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:51.884255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:51.884255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:51.884255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:51.884255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:51.884255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:51.884255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:51.884255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:51.884255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:51.884255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:51.884255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:52:51.884255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:52:51.884255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:52:51.885147 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:52:51.885147 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:51.885147 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:51.885147 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:51.885147 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:51.885147 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:51.885147 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:51.885147 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:51.885147 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:51.885147 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:51.885147 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:51.885147 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:51.885147 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:51.885147 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:51.885147 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:51.885147 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:51.885147 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:51.886997 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:52:51.886997 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:52:51.886997 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:52:51.886997 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:52:51.886997 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:52:51.886997 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:52:51.886997 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:52:51.886997 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:51.886997 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 371/748] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 27 18:52:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:51.886997 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809594f-aa4f-43c4-9edd-c0aab3fc732e None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:51.992626 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:52.003157 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809594f-aa4f-43c4-9edd-c0aab3fc732e None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:52.040239 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ba573-5970-494b-89ef-771b31c84a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:52.040880 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ba573-5970-494b-89ef-771b31c84a68 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:52.041155 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ba573-5970-494b-89ef-771b31c84a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:52.041422 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ba573-5970-494b-89ef-771b31c84a68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:52.056742 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705ba573-5970-494b-89ef-771b31c84a68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:52.058194 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705ba573-5970-494b-89ef-771b31c84a68 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:52.071867 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0fb147-5291-43eb-958f-708dfa74f066 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:52.077447 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-705ba573-5970-494b-89ef-771b31c84a68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:52.077447 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:52.077447 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:52.077447 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:52.077447 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:52.077447 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:52.077447 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:52.077447 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:52.077447 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:52.077447 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:52.077447 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:52.077447 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:52.077447 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:52:52.077447 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:52:52.077447 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:52:52.078328 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:52:52.078328 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:52.078328 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:52.078328 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:52.078328 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:52.078328 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:52.078328 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:52.078328 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:52.078328 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:52.078328 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:52.078328 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:52.078328 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:52.078328 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:52.078328 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:52.078328 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:52.078328 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:52.078328 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:52.079206 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:52:52.079206 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:52:52.079206 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:52.079206 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:52.085632 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 372/749] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:52:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:52.086483 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ba573-5970-494b-89ef-771b31c84a68 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:52.113211 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d298bd-2f53-420a-88f1-327b0bb47ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:52.113904 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d298bd-2f53-420a-88f1-327b0bb47ae5 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:52.114188 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d298bd-2f53-420a-88f1-327b0bb47ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:52.114460 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d298bd-2f53-420a-88f1-327b0bb47ae5 None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:52.115308 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d298bd-2f53-420a-88f1-327b0bb47ae5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:52.115618 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d298bd-2f53-420a-88f1-327b0bb47ae5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:52.117701 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d298bd-2f53-420a-88f1-327b0bb47ae5 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:52.135662 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 378/750] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Jul 27 18:52:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:52.136609 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d298bd-2f53-420a-88f1-327b0bb47ae5 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:52.156419 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:52.212885 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ba573-5970-494b-89ef-771b31c84a68 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:52.245612 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:52.252561 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81664e2c-6072-4698-9556-299cc935fa44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:52.253287 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81664e2c-6072-4698-9556-299cc935fa44 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:52.253645 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81664e2c-6072-4698-9556-299cc935fa44 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:52.254183 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81664e2c-6072-4698-9556-299cc935fa44 None admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:52.254807 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81664e2c-6072-4698-9556-299cc935fa44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:52.255186 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81664e2c-6072-4698-9556-299cc935fa44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:52.256760 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81664e2c-6072-4698-9556-299cc935fa44 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:52.269508 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 373/751] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 27 18:52:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:52.274637 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d298bd-2f53-420a-88f1-327b0bb47ae5 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:52.275698 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81664e2c-6072-4698-9556-299cc935fa44 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:52.312850 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a3612-b713-480f-99c7-8d424720722c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:52.313779 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a3612-b713-480f-99c7-8d424720722c None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:52.314229 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a3612-b713-480f-99c7-8d424720722c None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:52.314670 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a3612-b713-480f-99c7-8d424720722c None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:52.315579 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a3612-b713-480f-99c7-8d424720722c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:52.316233 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a3612-b713-480f-99c7-8d424720722c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:52.317775 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a3612-b713-480f-99c7-8d424720722c None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:52.335218 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 379/752] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:52:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:52.337067 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a3612-b713-480f-99c7-8d424720722c None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:52.378722 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81664e2c-6072-4698-9556-299cc935fa44 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:52.413726 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7241a97d-8f2f-4c83-baa4-00cc8696abb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:52.414402 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241a97d-8f2f-4c83-baa4-00cc8696abb9 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:52.414690 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241a97d-8f2f-4c83-baa4-00cc8696abb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:52.414958 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241a97d-8f2f-4c83-baa4-00cc8696abb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:52.421546 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:52.427052 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7241a97d-8f2f-4c83-baa4-00cc8696abb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:52.428596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7241a97d-8f2f-4c83-baa4-00cc8696abb9 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:52.445105 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-7241a97d-8f2f-4c83-baa4-00cc8696abb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:52.445105 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:52.445105 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:52.445105 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:52.445105 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:52.445105 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:52.445105 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:52.445105 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:52.445105 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:52.445105 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:52.445105 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:52.445105 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:52.445105 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:52:52.445105 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:52:52.445105 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:52:52.446517 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:52:52.446517 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:52.446517 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:52.446517 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:52.446517 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:52.446517 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:52.446517 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:52.446517 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:52.446517 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:52.446517 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:52.446517 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:52.446517 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:52.446517 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:52.446517 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:52.446517 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:52.446517 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:52.446517 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:52.447414 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:52:52.447414 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:52:52.447414 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:52.447414 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:52.447414 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 374/753] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:52:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:52.448175 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7241a97d-8f2f-4c83-baa4-00cc8696abb9 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:52.452882 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a3612-b713-480f-99c7-8d424720722c None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:52.489070 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb10b20-4e76-4638-b3f4-089341cbe27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:52.490094 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb10b20-4e76-4638-b3f4-089341cbe27d None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:52.490580 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb10b20-4e76-4638-b3f4-089341cbe27d None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:52.491089 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb10b20-4e76-4638-b3f4-089341cbe27d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:52.492725 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb10b20-4e76-4638-b3f4-089341cbe27d None admin] RBAC: Adding query filter params (role.id=0f4a39b061e148418413cfe647af9a34, scope.project.id=31f027c53398443eb548eaf3f24523e0, user.id=16a9f1909ab3458c8c131986e303831a) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:52.493234 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb10b20-4e76-4638-b3f4-089341cbe27d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:52.494934 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb10b20-4e76-4638-b3f4-089341cbe27d None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:52.495862 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:52.503414 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 380/754] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 27 18:52:52 2022] GET /identity/v3/role_assignments?user.id=16a9f1909ab3458c8c131986e303831a&scope.project.id=31f027c53398443eb548eaf3f24523e0&role.id=0f4a39b061e148418413cfe647af9a34 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:52.504737 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb10b20-4e76-4638-b3f4-089341cbe27d None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:52.562641 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7241a97d-8f2f-4c83-baa4-00cc8696abb9 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:52.609867 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52310100-55e0-4537-9ebe-8551c6eedf32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:52.612055 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52310100-55e0-4537-9ebe-8551c6eedf32 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:52.612508 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52310100-55e0-4537-9ebe-8551c6eedf32 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:52.612923 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52310100-55e0-4537-9ebe-8551c6eedf32 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:52.624283 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52310100-55e0-4537-9ebe-8551c6eedf32 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:52.626852 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52310100-55e0-4537-9ebe-8551c6eedf32 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:52.644693 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-52310100-55e0-4537-9ebe-8551c6eedf32 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 18:52:52.644693 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:52.644693 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:52.644693 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:52.644693 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:52.644693 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:52.644693 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:52.644693 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:52.644693 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:52.644693 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:52.644693 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:52.644693 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:52.644693 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:52:52.644693 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:52:52.644693 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:52:52.644693 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:52:52.645742 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:52.645742 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:52.645742 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:52:52.645742 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:52:52.645742 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:52:52.645742 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:52:52.645742 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:52.645742 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:52.645742 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:52.645742 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:52.645742 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:52.645742 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:52.645742 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:52.645742 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:52.645742 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:52.645742 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:52.645742 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:52.645742 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:52.646675 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:52.646675 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:52.646675 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:52:52.646675 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:52:52.646675 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:52:52.646675 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:52:52.646675 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:52:52.646675 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:52:52.646675 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 18:52:52.646675 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:52.652581 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 375/755] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Jul 27 18:52:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:52.652581 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ccd9f2-6804-4c40-afa1-fed4be90e4eb None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:52.652581 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ccd9f2-6804-4c40-afa1-fed4be90e4eb None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:52.652581 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ccd9f2-6804-4c40-afa1-fed4be90e4eb None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:52.652581 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 376/756] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:52:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:52:52.655341 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb10b20-4e76-4638-b3f4-089341cbe27d None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:52.656709 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ccd9f2-6804-4c40-afa1-fed4be90e4eb None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:52.701455 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed097b-9da5-4a38-91f1-c480608d5916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:52.702061 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed097b-9da5-4a38-91f1-c480608d5916 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:52.702393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed097b-9da5-4a38-91f1-c480608d5916 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:52.702666 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed097b-9da5-4a38-91f1-c480608d5916 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:52.703349 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed097b-9da5-4a38-91f1-c480608d5916 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:52.703735 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed097b-9da5-4a38-91f1-c480608d5916 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:52.705071 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed097b-9da5-4a38-91f1-c480608d5916 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:52.712321 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:52.718588 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 381/757] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:52:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:52.719730 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224ad2f-a2fb-4530-888a-5816bde846ab None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:52.720003 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224ad2f-a2fb-4530-888a-5816bde846ab None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:52.720327 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224ad2f-a2fb-4530-888a-5816bde846ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:52.741123 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-f224ad2f-a2fb-4530-888a-5816bde846ab None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:52.742630 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-f224ad2f-a2fb-4530-888a-5816bde846ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:52.786538 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ccd9f2-6804-4c40-afa1-fed4be90e4eb None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:52.788541 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:52.829068 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c12de54-4f20-415b-b433-efc652c335eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:52.830060 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12de54-4f20-415b-b433-efc652c335eb None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:52.830628 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12de54-4f20-415b-b433-efc652c335eb None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:52.831164 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12de54-4f20-415b-b433-efc652c335eb None admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:52.832272 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c12de54-4f20-415b-b433-efc652c335eb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:52.832823 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c12de54-4f20-415b-b433-efc652c335eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:52.834514 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c12de54-4f20-415b-b433-efc652c335eb None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:52.839759 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 382/758] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:52:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:52:52.840828 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224ad2f-a2fb-4530-888a-5816bde846ab None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:52.865455 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 377/759] 10.222.0.20 () {56 vars in 1149 bytes} [Wed Jul 27 18:52:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:52.870910 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c12de54-4f20-415b-b433-efc652c335eb None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:52.975365 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c12de54-4f20-415b-b433-efc652c335eb None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:52.975586 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224ad2f-a2fb-4530-888a-5816bde846ab None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:53.011661 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a0e23b-77fa-4399-92a4-3d311fe67245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:53.013036 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0e23b-77fa-4399-92a4-3d311fe67245 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:53.013527 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0e23b-77fa-4399-92a4-3d311fe67245 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:53.014074 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0e23b-77fa-4399-92a4-3d311fe67245 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:53.015053 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a0e23b-77fa-4399-92a4-3d311fe67245 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:53.016039 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:53.017596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a0e23b-77fa-4399-92a4-3d311fe67245 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:53.018085 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b43c65-72e2-4651-a4e9-facb7240b709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:53.018793 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b43c65-72e2-4651-a4e9-facb7240b709 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:53.019069 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b43c65-72e2-4651-a4e9-facb7240b709 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:53.019342 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b43c65-72e2-4651-a4e9-facb7240b709 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:53.027147 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b43c65-72e2-4651-a4e9-facb7240b709 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:53.028594 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b43c65-72e2-4651-a4e9-facb7240b709 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:53.029259 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-d1a0e23b-77fa-4399-92a4-3d311fe67245 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 18:52:53.029259 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:53.029259 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:52:53.029259 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:52:53.029259 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:52:53.029259 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:52:53.029259 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:52:53.029259 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:52:53.029259 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 18:52:53.029259 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:53.029259 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:52:53.029259 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:53.029259 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:53.029259 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:53.029259 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:53.029259 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:53.030154 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:53.030154 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:53.030154 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:53.030154 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:53.030154 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:53.030154 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:53.030154 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:53.030154 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:52:53.030154 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:52:53.030154 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:52:53.030154 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:52:53.030154 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:53.030154 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:53.030154 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:53.030154 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:53.030154 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:53.030973 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:53.030973 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:53.030973 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:53.030973 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:53.030973 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:53.030973 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:53.030973 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:53.030973 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:53.030973 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:53.030973 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:53.030973 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:53.030973 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:52:53.030973 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:52:53.030973 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 18:52:53.030973 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:53.033735 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 378/760] 10.222.0.20 () {56 vars in 1129 bytes} [Wed Jul 27 18:52:52 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:53.034716 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a0e23b-77fa-4399-92a4-3d311fe67245 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:53.053317 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-d6b43c65-72e2-4651-a4e9-facb7240b709 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:52:53.053317 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:53.053317 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:53.053317 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:53.053317 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:53.053317 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:53.053317 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:53.053317 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:53.053317 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:53.053317 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:53.053317 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:53.053317 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:53.053317 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:52:53.053317 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:52:53.053317 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:52:53.054212 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:52:53.054212 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:53.054212 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:53.054212 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:53.054212 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:53.054212 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:53.054212 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:53.054212 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:53.054212 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:53.054212 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:53.054212 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:53.054212 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:53.054212 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:53.054212 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:53.054212 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:53.054212 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:53.054212 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:53.055780 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:52:53.055780 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:52:53.055780 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:52:53.055780 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:52:53.055780 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:52:53.055780 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:52:53.055780 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:52:53.055780 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:53.055780 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 383/761] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 27 18:52:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:53.056264 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b43c65-72e2-4651-a4e9-facb7240b709 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:53.067217 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:53.166335 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a0e23b-77fa-4399-92a4-3d311fe67245 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:53.168314 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b43c65-72e2-4651-a4e9-facb7240b709 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:53.201161 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e270eb42-abd0-4d1e-8a49-8830a3ec1a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:53.202126 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270eb42-abd0-4d1e-8a49-8830a3ec1a36 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:53.202602 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270eb42-abd0-4d1e-8a49-8830a3ec1a36 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:53.203074 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270eb42-abd0-4d1e-8a49-8830a3ec1a36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:53.213278 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f4b74-8323-4424-86dd-a9477c1e9e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:53.214227 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f4b74-8323-4424-86dd-a9477c1e9e29 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:53.214699 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f4b74-8323-4424-86dd-a9477c1e9e29 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:53.215163 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f4b74-8323-4424-86dd-a9477c1e9e29 None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:53.216076 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21f4b74-8323-4424-86dd-a9477c1e9e29 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:53.216572 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21f4b74-8323-4424-86dd-a9477c1e9e29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:53.218231 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21f4b74-8323-4424-86dd-a9477c1e9e29 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:53.224734 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 384/762] 10.222.0.20 () {56 vars in 1124 bytes} [Wed Jul 27 18:52:53 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:53.226023 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f4b74-8323-4424-86dd-a9477c1e9e29 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:53.285406 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:53.300121 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e270eb42-abd0-4d1e-8a49-8830a3ec1a36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:53.301868 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e270eb42-abd0-4d1e-8a49-8830a3ec1a36 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:53.326291 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:53.346517 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f4b74-8323-4424-86dd-a9477c1e9e29 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:53.387198 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7b110c-ba6d-4e56-b985-1d28301bb84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:53.388360 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b110c-ba6d-4e56-b985-1d28301bb84e None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:53.388869 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b110c-ba6d-4e56-b985-1d28301bb84e None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:53.389337 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b110c-ba6d-4e56-b985-1d28301bb84e None admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:53.390369 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7b110c-ba6d-4e56-b985-1d28301bb84e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:53.390875 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7b110c-ba6d-4e56-b985-1d28301bb84e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:53.392677 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7b110c-ba6d-4e56-b985-1d28301bb84e None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:53.406870 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 385/763] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 27 18:52:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:53.408278 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7b110c-ba6d-4e56-b985-1d28301bb84e None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:53.419722 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 379/764] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 27 18:52:53 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 18:52:53.419722 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e270eb42-abd0-4d1e-8a49-8830a3ec1a36 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:53.542078 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7b110c-ba6d-4e56-b985-1d28301bb84e None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:53.542615 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e270eb42-abd0-4d1e-8a49-8830a3ec1a36 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:53.559865 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:53.573970 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:53.585168 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d59d4d0-58b3-468e-b6ab-88b5359e4af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:53.586622 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59d4d0-58b3-468e-b6ab-88b5359e4af6 None admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:53.587095 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59d4d0-58b3-468e-b6ab-88b5359e4af6 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:53.587598 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59d4d0-58b3-468e-b6ab-88b5359e4af6 None admin] PATH_INFO: `/v3/projects/31f027c53398443eb548eaf3f24523e0/users/17fbef9db7734283aaad4962ee160171/roles/0f4a39b061e148418413cfe647af9a34` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:53.588338 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c36f6e-9584-42d3-b6e9-eea74f60a01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:53.588954 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c36f6e-9584-42d3-b6e9-eea74f60a01f None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:53.589233 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c36f6e-9584-42d3-b6e9-eea74f60a01f None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:53.589503 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c36f6e-9584-42d3-b6e9-eea74f60a01f None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:53.590177 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c36f6e-9584-42d3-b6e9-eea74f60a01f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:53.590480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c36f6e-9584-42d3-b6e9-eea74f60a01f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:53.590970 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d59d4d0-58b3-468e-b6ab-88b5359e4af6 None admin] RBAC: Authorizing `identity:create_grant(project_id=31f027c53398443eb548eaf3f24523e0, user_id=17fbef9db7734283aaad4962ee160171, role_id=0f4a39b061e148418413cfe647af9a34)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:53.591858 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c36f6e-9584-42d3-b6e9-eea74f60a01f None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:53.592817 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d59d4d0-58b3-468e-b6ab-88b5359e4af6 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:53.596798 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 386/765] 10.222.0.20 () {56 vars in 1124 bytes} [Wed Jul 27 18:52:53 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:53.597694 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c36f6e-9584-42d3-b6e9-eea74f60a01f None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:53.610722 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 380/766] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 27 18:52:53 2022] PUT /identity/v3/projects/31f027c53398443eb548eaf3f24523e0/users/17fbef9db7734283aaad4962ee160171/roles/0f4a39b061e148418413cfe647af9a34 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:53.612026 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5cb36b-b48b-4253-a953-3a5828712587 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:53.612315 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5cb36b-b48b-4253-a953-3a5828712587 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:53.612583 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5cb36b-b48b-4253-a953-3a5828712587 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:53.618403 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 381/767] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:52:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:52:53.619394 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5cb36b-b48b-4253-a953-3a5828712587 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:53.733655 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c36f6e-9584-42d3-b6e9-eea74f60a01f None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:53.734945 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5cb36b-b48b-4253-a953-3a5828712587 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:53.774019 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7274f575-0768-4e63-92b8-5d08d9e2e472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:53.774446 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43cea72-9303-41d6-bcd2-474bd9846da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:53.775164 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43cea72-9303-41d6-bcd2-474bd9846da6 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:53.775446 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43cea72-9303-41d6-bcd2-474bd9846da6 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:53.775654 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274f575-0768-4e63-92b8-5d08d9e2e472 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:53.775775 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43cea72-9303-41d6-bcd2-474bd9846da6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:53.776245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274f575-0768-4e63-92b8-5d08d9e2e472 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:53.776806 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274f575-0768-4e63-92b8-5d08d9e2e472 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:53.777718 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7274f575-0768-4e63-92b8-5d08d9e2e472 None admin] RBAC: Adding query filter params (interface=public, service_id=a14416f05c024e85af00d1139e0a1a4f, region_id=RegionOne) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:53.778261 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7274f575-0768-4e63-92b8-5d08d9e2e472 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:53.779798 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7274f575-0768-4e63-92b8-5d08d9e2e472 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:53.788788 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 382/768] 10.222.0.20 () {56 vars in 1251 bytes} [Wed Jul 27 18:52:53 2022] GET /identity/v3/endpoints?service_id=a14416f05c024e85af00d1139e0a1a4f&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:53.789412 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43cea72-9303-41d6-bcd2-474bd9846da6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:53.790376 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a6758-90ab-4786-8cee-5bccb9149ac6 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:53.790826 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a6758-90ab-4786-8cee-5bccb9149ac6 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:53.791241 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a6758-90ab-4786-8cee-5bccb9149ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:53.791363 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43cea72-9303-41d6-bcd2-474bd9846da6 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:53.809114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-d43cea72-9303-41d6-bcd2-474bd9846da6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:53.809114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:53.809114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:53.809114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:53.809114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:53.809114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:53.809114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:53.809114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:53.809114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:53.809114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:53.809114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:53.809114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:53.809114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:52:53.809114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:52:53.809114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:52:53.810259 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:52:53.810259 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:53.810259 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:53.810259 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:53.810259 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:53.810259 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:53.810259 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:53.810259 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:53.810259 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:53.810259 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:53.810259 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:53.810259 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:53.810259 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:53.810259 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:53.810259 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:53.810259 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:53.810259 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:53.811162 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:52:53.811162 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:52:53.811162 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:53.811162 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:53.811390 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 387/769] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:52:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:53.812477 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43cea72-9303-41d6-bcd2-474bd9846da6 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:53.812765 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-f93a6758-90ab-4786-8cee-5bccb9149ac6 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:53.814178 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-f93a6758-90ab-4786-8cee-5bccb9149ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:53.844954 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:53.880053 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:53.892428 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 383/770] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:52:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:52:53.893391 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a6758-90ab-4786-8cee-5bccb9149ac6 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:53.925593 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43cea72-9303-41d6-bcd2-474bd9846da6 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:53.961305 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6bd25e-9e0c-4723-92eb-cb567bee2770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:53.962408 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6bd25e-9e0c-4723-92eb-cb567bee2770 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:53.962863 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6bd25e-9e0c-4723-92eb-cb567bee2770 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:53.963303 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6bd25e-9e0c-4723-92eb-cb567bee2770 None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:53.964155 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6bd25e-9e0c-4723-92eb-cb567bee2770 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:53.965780 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6bd25e-9e0c-4723-92eb-cb567bee2770 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:53.971754 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 388/771] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Jul 27 18:52:53 2022] GET /identity/v3/services => generated 772 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:53.973003 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6bd25e-9e0c-4723-92eb-cb567bee2770 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:54.021067 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a6758-90ab-4786-8cee-5bccb9149ac6 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:54.068397 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df531c00-18ca-4b8f-b1a3-29201155e05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:54.070948 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df531c00-18ca-4b8f-b1a3-29201155e05a None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:54.071186 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df531c00-18ca-4b8f-b1a3-29201155e05a None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:54.071463 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df531c00-18ca-4b8f-b1a3-29201155e05a None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:54.072222 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df531c00-18ca-4b8f-b1a3-29201155e05a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:54.072530 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df531c00-18ca-4b8f-b1a3-29201155e05a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:54.074228 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df531c00-18ca-4b8f-b1a3-29201155e05a None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:54.102162 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 384/772] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:52:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:54.103665 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df531c00-18ca-4b8f-b1a3-29201155e05a None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:54.140604 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:54.148672 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6bd25e-9e0c-4723-92eb-cb567bee2770 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:54.185821 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddaae2a-2060-4173-8b34-f8874335a9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:54.187288 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddaae2a-2060-4173-8b34-f8874335a9e6 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:54.187812 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddaae2a-2060-4173-8b34-f8874335a9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:54.188281 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddaae2a-2060-4173-8b34-f8874335a9e6 None admin] PATH_INFO: `/v3/services/network` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:54.189108 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddaae2a-2060-4173-8b34-f8874335a9e6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:54.190678 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddaae2a-2060-4173-8b34-f8874335a9e6 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:54.192068 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:54.202529 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-fddaae2a-2060-4173-8b34-f8874335a9e6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 18:52:54.202529 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:54.202529 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:52:54.202529 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:52:54.202529 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:52:54.202529 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:52:54.202529 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:52:54.202529 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:52:54.202529 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 18:52:54.202529 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:54.202529 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:52:54.202529 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:54.202529 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:54.202529 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:54.202529 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:54.202529 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:54.202529 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:54.203568 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:54.203568 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:54.203568 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:54.203568 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:54.203568 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:54.203568 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:54.203568 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:52:54.203568 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:52:54.203568 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:52:54.203568 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:52:54.203568 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:54.203568 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:54.203568 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:54.203568 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:54.203568 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:54.203568 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:54.204439 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:54.204439 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:54.204439 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:54.204439 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:54.204439 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:54.204439 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:54.204439 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:54.204439 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:54.204439 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:54.204439 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:54.204439 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:52:54.204439 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:52:54.204439 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 18:52:54.204439 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:54.207297 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 389/773] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 27 18:52:53 2022] GET /identity/v3/services/network => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:54.212969 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddaae2a-2060-4173-8b34-f8874335a9e6 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:54.291749 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df531c00-18ca-4b8f-b1a3-29201155e05a None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:54.333104 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddaae2a-2060-4173-8b34-f8874335a9e6 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:54.349564 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4292ff9-1c4a-429a-bb6d-de56e17ff4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:54.350526 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4292ff9-1c4a-429a-bb6d-de56e17ff4f4 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:54.352285 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4292ff9-1c4a-429a-bb6d-de56e17ff4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:54.352778 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4292ff9-1c4a-429a-bb6d-de56e17ff4f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:54.365143 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4292ff9-1c4a-429a-bb6d-de56e17ff4f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:54.368456 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4292ff9-1c4a-429a-bb6d-de56e17ff4f4 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:54.395710 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-e4292ff9-1c4a-429a-bb6d-de56e17ff4f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:52:54.395710 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:54.395710 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:54.395710 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:54.395710 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:54.395710 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:54.395710 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:54.395710 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:54.395710 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:54.395710 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:54.395710 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:54.395710 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:54.395710 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:52:54.395710 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:52:54.395710 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:52:54.396651 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:52:54.396651 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:54.396651 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:54.396651 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:54.396651 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:54.396651 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:54.396651 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:54.396651 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:54.396651 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:54.396651 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:54.396651 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:54.396651 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:54.396651 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:54.396651 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:54.396651 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:54.396651 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:54.396651 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:54.397513 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:52:54.397513 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:52:54.397513 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:52:54.397513 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:52:54.397513 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:52:54.397513 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:52:54.397513 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:52:54.397513 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:54.402642 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 385/774] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 27 18:52:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:52:54.408234 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4292ff9-1c4a-429a-bb6d-de56e17ff4f4 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:54.415444 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c47fd9-c824-4921-a51d-31b1b2bbd83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:54.416342 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c47fd9-c824-4921-a51d-31b1b2bbd83b None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:54.416818 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c47fd9-c824-4921-a51d-31b1b2bbd83b None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:54.417295 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c47fd9-c824-4921-a51d-31b1b2bbd83b None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:54.418167 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c47fd9-c824-4921-a51d-31b1b2bbd83b None admin] RBAC: Adding query filter params (name=network) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:54.420710 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c47fd9-c824-4921-a51d-31b1b2bbd83b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:54.422306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c47fd9-c824-4921-a51d-31b1b2bbd83b None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:54.429091 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 390/775] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Jul 27 18:52:54 2022] GET /identity/v3/services?name=network => generated 124 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:52:54.435234 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c47fd9-c824-4921-a51d-31b1b2bbd83b None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:54.462072 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:54.546691 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c47fd9-c824-4921-a51d-31b1b2bbd83b None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:54.553357 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:54.558217 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4292ff9-1c4a-429a-bb6d-de56e17ff4f4 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:54.609382 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca5a3a8-1fe4-4d88-9e91-8b58fe603b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:54.610987 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5a3a8-1fe4-4d88-9e91-8b58fe603b22 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:54.612279 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5a3a8-1fe4-4d88-9e91-8b58fe603b22 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:54.613243 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5a3a8-1fe4-4d88-9e91-8b58fe603b22 None admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:54.614005 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eeb128-773e-4fd0-9655-a977481075fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:54.614945 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca5a3a8-1fe4-4d88-9e91-8b58fe603b22 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:54.615759 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eeb128-773e-4fd0-9655-a977481075fd None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:54.616218 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca5a3a8-1fe4-4d88-9e91-8b58fe603b22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:54.616639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eeb128-773e-4fd0-9655-a977481075fd None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:54.618270 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca5a3a8-1fe4-4d88-9e91-8b58fe603b22 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:54.618698 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eeb128-773e-4fd0-9655-a977481075fd None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:54.619543 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eeb128-773e-4fd0-9655-a977481075fd None admin] RBAC: Adding query filter params (type=network) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:54.620017 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eeb128-773e-4fd0-9655-a977481075fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:54.623052 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eeb128-773e-4fd0-9655-a977481075fd None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:54.636202 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 391/776] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Jul 27 18:52:54 2022] GET /identity/v3/services?type=network => generated 350 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:52:54.640387 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 386/777] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 27 18:52:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:54.646129 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eeb128-773e-4fd0-9655-a977481075fd None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:54.650454 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca5a3a8-1fe4-4d88-9e91-8b58fe603b22 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:54.745266 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:54.767599 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eeb128-773e-4fd0-9655-a977481075fd None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:54.779882 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca5a3a8-1fe4-4d88-9e91-8b58fe603b22 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:54.812662 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452a2be-1880-454f-9131-b29d4b42b936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:54.813611 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452a2be-1880-454f-9131-b29d4b42b936 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:54.814166 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452a2be-1880-454f-9131-b29d4b42b936 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:54.814585 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452a2be-1880-454f-9131-b29d4b42b936 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:54.815723 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0452a2be-1880-454f-9131-b29d4b42b936 None admin] RBAC: Adding query filter params (interface=public, service_id=da2085e630f843898804d8ff9435fb48, region_id=RegionOne) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:54.816184 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0452a2be-1880-454f-9131-b29d4b42b936 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:54.816601 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc4b17-abf4-4d4c-a98a-e2646a2c704c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:54.817301 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc4b17-abf4-4d4c-a98a-e2646a2c704c None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:54.817684 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc4b17-abf4-4d4c-a98a-e2646a2c704c None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:54.818049 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc4b17-abf4-4d4c-a98a-e2646a2c704c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:54.818365 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0452a2be-1880-454f-9131-b29d4b42b936 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:54.819013 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc4b17-abf4-4d4c-a98a-e2646a2c704c None admin] RBAC: Adding query filter params (role.id=306da3282d854292a7a53b8642ee373b, scope.project.id=31f027c53398443eb548eaf3f24523e0, user.id=a277ddae777442869114c4c5deff7d7e) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:54.819414 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc4b17-abf4-4d4c-a98a-e2646a2c704c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:54.821842 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc4b17-abf4-4d4c-a98a-e2646a2c704c None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:54.835731 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 387/778] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 27 18:52:54 2022] GET /identity/v3/role_assignments?user.id=a277ddae777442869114c4c5deff7d7e&scope.project.id=31f027c53398443eb548eaf3f24523e0&role.id=306da3282d854292a7a53b8642ee373b => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:54.835731 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c4c87-2470-478b-9b03-5c182e1f96ea None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:54.835731 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c4c87-2470-478b-9b03-5c182e1f96ea None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:54.835731 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c4c87-2470-478b-9b03-5c182e1f96ea None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:54.835731 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 388/779] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:52:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:52:54.836216 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 392/780] 10.222.0.20 () {56 vars in 1251 bytes} [Wed Jul 27 18:52:54 2022] GET /identity/v3/endpoints?service_id=da2085e630f843898804d8ff9435fb48&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:54.840857 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c4c87-2470-478b-9b03-5c182e1f96ea None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:54.842763 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba160a3a-73ed-4068-a8e6-a92deb154c51 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:54.843049 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba160a3a-73ed-4068-a8e6-a92deb154c51 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:54.843322 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba160a3a-73ed-4068-a8e6-a92deb154c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:54.880225 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-ba160a3a-73ed-4068-a8e6-a92deb154c51 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:54.881360 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-ba160a3a-73ed-4068-a8e6-a92deb154c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:54.891410 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:55.006368 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 393/781] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:52:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:52:55.034654 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba160a3a-73ed-4068-a8e6-a92deb154c51 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:55.037858 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c4c87-2470-478b-9b03-5c182e1f96ea None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:55.075044 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c766fdc-80bb-48fc-9173-5c490b31ef91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:55.075968 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c766fdc-80bb-48fc-9173-5c490b31ef91 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:55.076401 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c766fdc-80bb-48fc-9173-5c490b31ef91 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:55.076821 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c766fdc-80bb-48fc-9173-5c490b31ef91 None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:55.077720 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c766fdc-80bb-48fc-9173-5c490b31ef91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:55.079319 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c766fdc-80bb-48fc-9173-5c490b31ef91 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:55.085468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 389/782] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Jul 27 18:52:54 2022] GET /identity/v3/services => generated 772 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:55.157100 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:55.184593 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba160a3a-73ed-4068-a8e6-a92deb154c51 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:55.236848 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b244c9-2607-43e1-a448-9ef04385b53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:55.238246 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b244c9-2607-43e1-a448-9ef04385b53a None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:55.238704 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b244c9-2607-43e1-a448-9ef04385b53a None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:55.239140 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b244c9-2607-43e1-a448-9ef04385b53a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:55.256656 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b244c9-2607-43e1-a448-9ef04385b53a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:52:55.262089 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-30b244c9-2607-43e1-a448-9ef04385b53a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:52:55.262089 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:55.262089 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:55.262089 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:55.262089 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:55.262089 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:55.262089 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:55.262089 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:55.262089 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:55.262089 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:55.262089 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:55.262089 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:55.262089 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:52:55.262089 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:52:55.262089 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:52:55.262089 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:52:55.263325 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:52:55.263325 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:52:55.263325 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:52:55.263325 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:52:55.263325 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:55.263325 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:55.263325 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:55.263325 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:55.263325 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:55.263325 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:55.263325 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:55.263325 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:55.263325 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:55.263325 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:55.263325 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:55.263325 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:55.264397 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:55.264397 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:55.264397 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:55.264397 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:55.264397 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:52:55.264397 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:52:55.264397 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:52:55.264397 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:52:55.264397 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:52:55.264397 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:52:55.264397 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:52:55.264397 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:55.266969 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 394/783] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 27 18:52:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:52:55.273716 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c766fdc-80bb-48fc-9173-5c490b31ef91 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:55.365765 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:55.383868 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c766fdc-80bb-48fc-9173-5c490b31ef91 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:55.421967 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f0d5e-825c-434f-820e-fcab08187a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:55.422595 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f0d5e-825c-434f-820e-fcab08187a46 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:55.422880 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f0d5e-825c-434f-820e-fcab08187a46 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:55.423157 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f0d5e-825c-434f-820e-fcab08187a46 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:55.423926 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5f0d5e-825c-434f-820e-fcab08187a46 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:55.424242 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5f0d5e-825c-434f-820e-fcab08187a46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:55.425733 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5f0d5e-825c-434f-820e-fcab08187a46 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:55.440731 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 390/784] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 27 18:52:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:55.443844 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b244c9-2607-43e1-a448-9ef04385b53a None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:55.583447 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b244c9-2607-43e1-a448-9ef04385b53a None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:55.629410 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d7a9f-979c-4e4f-8b1e-5d936ae2aaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:55.630115 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d7a9f-979c-4e4f-8b1e-5d936ae2aaa7 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:55.630408 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d7a9f-979c-4e4f-8b1e-5d936ae2aaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:55.630681 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d7a9f-979c-4e4f-8b1e-5d936ae2aaa7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:55.640942 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:55.645383 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74d7a9f-979c-4e4f-8b1e-5d936ae2aaa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:55.646840 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74d7a9f-979c-4e4f-8b1e-5d936ae2aaa7 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:55.666779 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-b74d7a9f-979c-4e4f-8b1e-5d936ae2aaa7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:55.666779 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:55.666779 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:55.666779 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:55.666779 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:55.666779 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:55.666779 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:55.666779 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:55.666779 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:55.666779 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:55.666779 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:55.666779 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:55.666779 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:52:55.666779 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:52:55.666779 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:52:55.667919 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:52:55.667919 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:55.667919 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:55.667919 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:55.667919 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:55.667919 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:55.667919 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:55.667919 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:55.667919 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:55.667919 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:55.667919 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:55.667919 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:55.667919 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:55.667919 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:55.667919 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:55.667919 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:55.667919 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:55.668854 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:52:55.668854 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:52:55.668854 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:55.668854 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:55.668854 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 395/785] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:52:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:55.675068 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f0d5e-825c-434f-820e-fcab08187a46 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:55.811424 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f0d5e-825c-434f-820e-fcab08187a46 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:55.844774 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd9912-cb47-4e3b-9f10-af2d842b699f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:55.845574 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd9912-cb47-4e3b-9f10-af2d842b699f None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:55.845870 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd9912-cb47-4e3b-9f10-af2d842b699f None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:55.846141 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd9912-cb47-4e3b-9f10-af2d842b699f None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:55.846903 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cd9912-cb47-4e3b-9f10-af2d842b699f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:55.847214 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cd9912-cb47-4e3b-9f10-af2d842b699f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:55.848775 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cd9912-cb47-4e3b-9f10-af2d842b699f None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:55.867611 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 391/786] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:52:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:55.873136 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d7a9f-979c-4e4f-8b1e-5d936ae2aaa7 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:55.987380 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d7a9f-979c-4e4f-8b1e-5d936ae2aaa7 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:56.029092 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b5192-9e4a-4891-8e4c-fa02301f39f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:56.029741 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b5192-9e4a-4891-8e4c-fa02301f39f1 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:56.030023 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b5192-9e4a-4891-8e4c-fa02301f39f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:56.030303 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b5192-9e4a-4891-8e4c-fa02301f39f1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:56.044862 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797b5192-9e4a-4891-8e4c-fa02301f39f1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:56.046520 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797b5192-9e4a-4891-8e4c-fa02301f39f1 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:56.058377 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-797b5192-9e4a-4891-8e4c-fa02301f39f1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 18:52:56.058377 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:56.058377 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:56.058377 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:56.058377 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:56.058377 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:56.058377 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:56.058377 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:56.058377 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:56.058377 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:56.058377 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:56.058377 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:56.058377 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:52:56.058377 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:52:56.058377 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:52:56.058377 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:52:56.059922 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:56.059922 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:56.059922 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:52:56.059922 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:52:56.059922 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:52:56.059922 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:52:56.059922 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:56.059922 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:56.059922 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:56.059922 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:56.059922 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:56.059922 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:56.059922 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:56.059922 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:56.059922 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:56.059922 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:56.059922 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:56.059922 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:56.061468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:56.061468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:56.061468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:52:56.061468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:52:56.061468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:52:56.061468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:52:56.061468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:52:56.061468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:52:56.061468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 18:52:56.061468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:56.061468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 396/787] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 27 18:52:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:56.068995 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd9912-cb47-4e3b-9f10-af2d842b699f None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:56.088083 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:56.209341 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd9912-cb47-4e3b-9f10-af2d842b699f None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:56.246738 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d69d8-4e4d-4c8b-aa6d-57ffa2e33098 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:56.247262 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d69d8-4e4d-4c8b-aa6d-57ffa2e33098 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:56.247262 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d69d8-4e4d-4c8b-aa6d-57ffa2e33098 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:56.248617 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 397/788] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:52:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:52:56.259116 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c315479d-a65a-4a0d-bb50-e4b1b7c281f1 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:56.259116 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c315479d-a65a-4a0d-bb50-e4b1b7c281f1 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:56.259116 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c315479d-a65a-4a0d-bb50-e4b1b7c281f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:56.277655 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a23be-b429-464e-8d48-264b52df89c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:56.278655 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a23be-b429-464e-8d48-264b52df89c1 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:56.279145 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a23be-b429-464e-8d48-264b52df89c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:56.279618 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a23be-b429-464e-8d48-264b52df89c1 None admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:56.280721 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9a23be-b429-464e-8d48-264b52df89c1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:56.281492 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9a23be-b429-464e-8d48-264b52df89c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:56.286163 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9a23be-b429-464e-8d48-264b52df89c1 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:56.289819 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-c315479d-a65a-4a0d-bb50-e4b1b7c281f1 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:56.293083 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-c315479d-a65a-4a0d-bb50-e4b1b7c281f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:56.318152 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 392/789] 10.222.0.20 () {56 vars in 1135 bytes} [Wed Jul 27 18:52:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:52:56.324378 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a23be-b429-464e-8d48-264b52df89c1 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:56.379818 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:56.402368 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 398/790] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:52:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:52:56.402568 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:56.434791 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a23be-b429-464e-8d48-264b52df89c1 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:56.450127 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c315479d-a65a-4a0d-bb50-e4b1b7c281f1 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:56.469967 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e17cf-9cea-41e1-a595-bd3f05f4e6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:56.470838 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e17cf-9cea-41e1-a595-bd3f05f4e6d1 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:56.471267 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e17cf-9cea-41e1-a595-bd3f05f4e6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:56.471743 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e17cf-9cea-41e1-a595-bd3f05f4e6d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:56.482849 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e17cf-9cea-41e1-a595-bd3f05f4e6d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:56.484543 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e17cf-9cea-41e1-a595-bd3f05f4e6d1 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:56.500397 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-bb2e17cf-9cea-41e1-a595-bd3f05f4e6d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:56.500397 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:56.500397 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:56.500397 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:56.500397 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:56.500397 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:56.500397 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:56.500397 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:56.500397 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:56.500397 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:56.500397 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:56.500397 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:56.500397 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:52:56.500397 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:52:56.500397 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:52:56.501296 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:52:56.501296 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:56.501296 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:56.501296 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:56.501296 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:56.501296 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:56.501296 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:56.501296 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:56.501296 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:56.501296 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:56.501296 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:56.501296 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:56.501296 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:56.501296 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:56.501296 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:56.501296 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:56.501296 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:56.502197 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:52:56.502197 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:52:56.502197 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:56.502197 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:56.504401 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 393/791] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:52:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:52:56.510106 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e17cf-9cea-41e1-a595-bd3f05f4e6d1 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:56.650775 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c315479d-a65a-4a0d-bb50-e4b1b7c281f1 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:56.661403 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e17cf-9cea-41e1-a595-bd3f05f4e6d1 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:56.692079 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:56.702618 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d770f9-b5c5-495b-a194-6891c0f36a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:56.704311 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d770f9-b5c5-495b-a194-6891c0f36a54 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:56.704311 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d770f9-b5c5-495b-a194-6891c0f36a54 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:56.704311 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d770f9-b5c5-495b-a194-6891c0f36a54 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:56.712698 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe68382-93c2-4fc6-98f3-cdc5d758ffb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:56.713342 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe68382-93c2-4fc6-98f3-cdc5d758ffb4 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:56.713625 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe68382-93c2-4fc6-98f3-cdc5d758ffb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:56.713895 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe68382-93c2-4fc6-98f3-cdc5d758ffb4 None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:56.714586 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe68382-93c2-4fc6-98f3-cdc5d758ffb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:56.714892 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe68382-93c2-4fc6-98f3-cdc5d758ffb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:56.716281 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe68382-93c2-4fc6-98f3-cdc5d758ffb4 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:56.721850 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d770f9-b5c5-495b-a194-6891c0f36a54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:52:56.728112 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-14d770f9-b5c5-495b-a194-6891c0f36a54 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:52:56.728112 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:56.728112 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:56.728112 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:56.728112 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:56.728112 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:56.728112 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:56.728112 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:56.728112 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:56.728112 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:56.728112 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:56.728112 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:56.728112 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:52:56.728112 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:52:56.728112 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:52:56.728112 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:52:56.729038 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:52:56.729038 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:52:56.729038 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:52:56.729038 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:52:56.729038 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:56.729038 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:56.729038 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:56.729038 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:56.729038 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:56.729038 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:56.729038 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:56.729038 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:56.729038 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:56.729038 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:56.729038 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:56.729038 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:56.729872 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:56.729872 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:56.729872 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:56.729872 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:56.729872 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:52:56.729872 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:52:56.729872 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:52:56.729872 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:52:56.729872 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:52:56.729872 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:52:56.729872 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:52:56.729872 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:56.729872 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 399/792] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 27 18:52:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:56.731022 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f2925b-0170-4d67-870e-a22f784e8f29 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:56.731200 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f2925b-0170-4d67-870e-a22f784e8f29 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:56.731829 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f2925b-0170-4d67-870e-a22f784e8f29 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:56.735815 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 400/793] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:52:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:52:56.735815 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f2925b-0170-4d67-870e-a22f784e8f29 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:56.739625 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 394/794] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:52:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:52:56.744994 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cdaf02-f7e1-447b-93a9-ba46c26d4c4a None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:56.744994 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cdaf02-f7e1-447b-93a9-ba46c26d4c4a None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:56.744994 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cdaf02-f7e1-447b-93a9-ba46c26d4c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:56.766088 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-46cdaf02-f7e1-447b-93a9-ba46c26d4c4a None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:56.767589 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-46cdaf02-f7e1-447b-93a9-ba46c26d4c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:56.790460 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:56.863173 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f2925b-0170-4d67-870e-a22f784e8f29 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:56.872658 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 395/795] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:52:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:52:56.872658 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cdaf02-f7e1-447b-93a9-ba46c26d4c4a None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:56.920918 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477834c4-ee42-4970-8efd-a0f92dcdb150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:56.922436 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477834c4-ee42-4970-8efd-a0f92dcdb150 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:56.922914 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477834c4-ee42-4970-8efd-a0f92dcdb150 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:56.923383 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477834c4-ee42-4970-8efd-a0f92dcdb150 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:56.924724 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477834c4-ee42-4970-8efd-a0f92dcdb150 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:56.925624 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477834c4-ee42-4970-8efd-a0f92dcdb150 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:56.927486 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477834c4-ee42-4970-8efd-a0f92dcdb150 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:56.939650 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 401/796] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 27 18:52:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:56.940763 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477834c4-ee42-4970-8efd-a0f92dcdb150 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:56.989578 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cdaf02-f7e1-447b-93a9-ba46c26d4c4a None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:56.999869 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:57.033093 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc73eecd-41b8-40d7-88c9-4500c6fdf61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:57.033652 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73eecd-41b8-40d7-88c9-4500c6fdf61f None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:57.033953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73eecd-41b8-40d7-88c9-4500c6fdf61f None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:57.034309 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73eecd-41b8-40d7-88c9-4500c6fdf61f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:57.041945 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc73eecd-41b8-40d7-88c9-4500c6fdf61f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:57.043390 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc73eecd-41b8-40d7-88c9-4500c6fdf61f None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:57.055725 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-fc73eecd-41b8-40d7-88c9-4500c6fdf61f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:52:57.055725 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:57.055725 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:57.055725 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:57.055725 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:57.055725 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:57.055725 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:57.055725 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:57.055725 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:57.055725 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:57.055725 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:57.055725 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:57.055725 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:52:57.055725 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:52:57.055725 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:52:57.056611 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:52:57.056611 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:57.056611 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:57.056611 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:57.056611 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:57.056611 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:57.056611 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:57.056611 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:57.056611 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:57.056611 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:57.056611 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:57.056611 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:57.056611 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:57.056611 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:57.056611 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:57.056611 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:57.056611 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:57.057486 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:52:57.057486 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:52:57.057486 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:52:57.057486 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:52:57.057486 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:52:57.057486 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:52:57.057486 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:52:57.057486 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:57.062085 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 396/797] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 27 18:52:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:57.063119 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc73eecd-41b8-40d7-88c9-4500c6fdf61f None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:57.072950 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477834c4-ee42-4970-8efd-a0f92dcdb150 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:57.075225 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:57.110396 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40797ef7-2999-49b1-8a81-ebe9d4d4bb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:57.111028 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40797ef7-2999-49b1-8a81-ebe9d4d4bb0c None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:57.111302 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40797ef7-2999-49b1-8a81-ebe9d4d4bb0c None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:57.111567 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40797ef7-2999-49b1-8a81-ebe9d4d4bb0c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:57.112214 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40797ef7-2999-49b1-8a81-ebe9d4d4bb0c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:57.113552 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40797ef7-2999-49b1-8a81-ebe9d4d4bb0c None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:57.122296 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-40797ef7-2999-49b1-8a81-ebe9d4d4bb0c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 18:52:57.122296 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:57.122296 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:52:57.122296 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:52:57.122296 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:52:57.122296 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:52:57.122296 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:52:57.122296 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:52:57.122296 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 18:52:57.122296 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:57.122296 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:52:57.122296 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:57.122296 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:57.122296 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:57.122296 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:57.122296 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:57.123196 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:57.123196 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:57.123196 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:57.123196 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:57.123196 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:57.123196 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:57.123196 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:57.123196 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:52:57.123196 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:52:57.123196 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:52:57.123196 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:52:57.123196 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:57.123196 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:57.123196 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:57.123196 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:57.123196 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:57.124100 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:57.124100 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:57.124100 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:57.124100 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:57.124100 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:57.124100 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:57.124100 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:57.124100 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:57.124100 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:57.124100 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:57.124100 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:57.124100 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:52:57.124100 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:52:57.124100 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 18:52:57.124100 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:57.128642 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 402/798] 10.222.0.20 () {56 vars in 1129 bytes} [Wed Jul 27 18:52:56 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:57.129304 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40797ef7-2999-49b1-8a81-ebe9d4d4bb0c None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:57.184430 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc73eecd-41b8-40d7-88c9-4500c6fdf61f None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:57.223161 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2a671-cfb4-45e8-a1da-182d029beff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:57.223982 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2a671-cfb4-45e8-a1da-182d029beff9 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:57.224264 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2a671-cfb4-45e8-a1da-182d029beff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:57.224687 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2a671-cfb4-45e8-a1da-182d029beff9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:57.233416 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40797ef7-2999-49b1-8a81-ebe9d4d4bb0c None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:57.236517 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa2a671-cfb4-45e8-a1da-182d029beff9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:57.237964 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa2a671-cfb4-45e8-a1da-182d029beff9 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:57.253913 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-dfa2a671-cfb4-45e8-a1da-182d029beff9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:57.253913 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:57.253913 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:57.253913 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:57.253913 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:57.253913 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:57.253913 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:57.253913 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:57.253913 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:57.253913 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:57.253913 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:57.253913 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:57.253913 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:52:57.253913 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:52:57.253913 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:52:57.255081 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:52:57.255081 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:57.255081 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:57.255081 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:57.255081 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:57.255081 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:57.255081 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:57.255081 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:57.255081 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:57.255081 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:57.255081 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:57.255081 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:57.255081 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:57.255081 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:57.255081 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:57.255081 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:57.255081 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:57.256017 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:52:57.256017 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:52:57.256017 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:57.256017 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:57.256017 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 397/799] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:52:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:57.256370 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea43fcc-9f18-4586-a1c9-2eac3da8e28d None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:57.256520 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea43fcc-9f18-4586-a1c9-2eac3da8e28d None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:57.256796 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea43fcc-9f18-4586-a1c9-2eac3da8e28d None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:57.262209 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 398/800] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:52:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:52:57.262209 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea43fcc-9f18-4586-a1c9-2eac3da8e28d None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:57.276660 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8898ddba-58a6-4ad2-beb7-f71595562596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:57.277816 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898ddba-58a6-4ad2-beb7-f71595562596 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:57.278267 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898ddba-58a6-4ad2-beb7-f71595562596 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:57.278709 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898ddba-58a6-4ad2-beb7-f71595562596 None admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:57.279463 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8898ddba-58a6-4ad2-beb7-f71595562596 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:57.279801 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8898ddba-58a6-4ad2-beb7-f71595562596 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:57.281222 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8898ddba-58a6-4ad2-beb7-f71595562596 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:57.282102 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:57.299309 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 403/801] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 27 18:52:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:57.300180 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8898ddba-58a6-4ad2-beb7-f71595562596 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:57.329603 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:57.369846 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea43fcc-9f18-4586-a1c9-2eac3da8e28d None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:57.401953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba281c-4d16-4cde-8eb0-036617df792c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:57.402560 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba281c-4d16-4cde-8eb0-036617df792c None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:57.402835 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba281c-4d16-4cde-8eb0-036617df792c None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:57.403104 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba281c-4d16-4cde-8eb0-036617df792c None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:57.403807 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba281c-4d16-4cde-8eb0-036617df792c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:57.404115 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba281c-4d16-4cde-8eb0-036617df792c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:57.405470 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba281c-4d16-4cde-8eb0-036617df792c None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:57.409869 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 399/802] 10.222.0.20 () {56 vars in 1124 bytes} [Wed Jul 27 18:52:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:57.410330 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8898ddba-58a6-4ad2-beb7-f71595562596 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:57.411038 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38a911-e09f-410e-a1a3-c49a71ad1c75 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:57.411318 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38a911-e09f-410e-a1a3-c49a71ad1c75 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:57.411588 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38a911-e09f-410e-a1a3-c49a71ad1c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:57.430575 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-2d38a911-e09f-410e-a1a3-c49a71ad1c75 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:57.431760 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-2d38a911-e09f-410e-a1a3-c49a71ad1c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:57.451048 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a81e70-4c35-4088-98ec-7ec9c0b0facb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:57.451667 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a81e70-4c35-4088-98ec-7ec9c0b0facb None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:57.454048 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a81e70-4c35-4088-98ec-7ec9c0b0facb None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:57.454444 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a81e70-4c35-4088-98ec-7ec9c0b0facb None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:57.455251 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a81e70-4c35-4088-98ec-7ec9c0b0facb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:57.455557 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a81e70-4c35-4088-98ec-7ec9c0b0facb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:57.456934 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a81e70-4c35-4088-98ec-7ec9c0b0facb None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:57.473684 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 404/803] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:52:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:57.473684 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a81e70-4c35-4088-98ec-7ec9c0b0facb None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:57.502954 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 400/804] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:52:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:52:57.504225 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d38a911-e09f-410e-a1a3-c49a71ad1c75 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:57.522080 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:57.579383 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:57.595511 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a81e70-4c35-4088-98ec-7ec9c0b0facb None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:57.614181 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d38a911-e09f-410e-a1a3-c49a71ad1c75 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:57.632092 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2820453-3e0f-4332-8f51-b870d3b1bc77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:57.632787 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2820453-3e0f-4332-8f51-b870d3b1bc77 None admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:57.633065 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2820453-3e0f-4332-8f51-b870d3b1bc77 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:57.633334 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2820453-3e0f-4332-8f51-b870d3b1bc77 None admin] PATH_INFO: `/v3/projects/31f027c53398443eb548eaf3f24523e0/users/16a9f1909ab3458c8c131986e303831a/roles/0f4a39b061e148418413cfe647af9a34` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:57.635296 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2820453-3e0f-4332-8f51-b870d3b1bc77 None admin] RBAC: Authorizing `identity:create_grant(project_id=31f027c53398443eb548eaf3f24523e0, user_id=16a9f1909ab3458c8c131986e303831a, role_id=0f4a39b061e148418413cfe647af9a34)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:57.636750 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2820453-3e0f-4332-8f51-b870d3b1bc77 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:57.647649 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31707c3c-8124-47ca-a7f1-3631fdddccfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:57.648813 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31707c3c-8124-47ca-a7f1-3631fdddccfc None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:57.649100 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31707c3c-8124-47ca-a7f1-3631fdddccfc None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:57.649350 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31707c3c-8124-47ca-a7f1-3631fdddccfc None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:57.650016 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31707c3c-8124-47ca-a7f1-3631fdddccfc None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:57.650314 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31707c3c-8124-47ca-a7f1-3631fdddccfc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:57.655976 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 405/805] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 27 18:52:57 2022] PUT /identity/v3/projects/31f027c53398443eb548eaf3f24523e0/users/16a9f1909ab3458c8c131986e303831a/roles/0f4a39b061e148418413cfe647af9a34 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:52:57.656144 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31707c3c-8124-47ca-a7f1-3631fdddccfc None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:57.656221 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2820453-3e0f-4332-8f51-b870d3b1bc77 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:57.663422 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 401/806] 10.222.0.20 () {56 vars in 1124 bytes} [Wed Jul 27 18:52:57 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:57.663422 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31707c3c-8124-47ca-a7f1-3631fdddccfc None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:57.760303 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:57.786755 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2820453-3e0f-4332-8f51-b870d3b1bc77 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:57.792611 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31707c3c-8124-47ca-a7f1-3631fdddccfc None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:57.828640 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c3d0ec-8343-4d71-8125-974ae4eed7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:57.829292 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3d0ec-8343-4d71-8125-974ae4eed7c8 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:57.829628 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3d0ec-8343-4d71-8125-974ae4eed7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:57.829853 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3d0ec-8343-4d71-8125-974ae4eed7c8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:57.833469 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dda561-9814-4efb-ace3-1ebb74511e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:57.834210 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dda561-9814-4efb-ace3-1ebb74511e77 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:57.834588 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dda561-9814-4efb-ace3-1ebb74511e77 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:57.834952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dda561-9814-4efb-ace3-1ebb74511e77 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:57.838352 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c3d0ec-8343-4d71-8125-974ae4eed7c8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:57.839806 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c3d0ec-8343-4d71-8125-974ae4eed7c8 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:57.846797 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dda561-9814-4efb-ace3-1ebb74511e77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:52:57.851779 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-d3c3d0ec-8343-4d71-8125-974ae4eed7c8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 18:52:57.851779 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:57.851779 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:57.851779 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:57.851779 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:57.851779 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:57.851779 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:57.851779 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:57.851779 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:57.851779 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:57.851779 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:57.851779 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:57.851779 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:52:57.851779 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:52:57.851779 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:52:57.851779 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:52:57.852877 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:57.852877 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:57.852877 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:52:57.852877 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:52:57.852877 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:52:57.852877 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:52:57.852877 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:57.852877 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:57.852877 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:57.852877 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:57.852877 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:57.852877 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:57.852877 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:57.852877 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:57.852877 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:57.852877 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:57.852877 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:57.852877 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:57.854132 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:57.854132 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:57.854132 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:52:57.854132 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:52:57.854132 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:52:57.854132 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:52:57.854132 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:52:57.854132 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:52:57.854132 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 18:52:57.854132 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:57.854132 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 406/807] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Jul 27 18:52:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:57.854132 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c3d0ec-8343-4d71-8125-974ae4eed7c8 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:57.854939 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-d9dda561-9814-4efb-ace3-1ebb74511e77 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:52:57.854939 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:57.854939 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:57.854939 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:57.854939 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:57.854939 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:57.854939 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:57.854939 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:57.854939 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:57.854939 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:57.854939 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:57.854939 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:57.854939 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:52:57.854939 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:52:57.854939 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:52:57.854939 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:52:57.857134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:52:57.857134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:52:57.857134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:52:57.857134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:52:57.857134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:57.857134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:57.857134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:57.857134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:57.857134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:57.857134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:57.857134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:57.857134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:57.857134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:57.857134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:57.857134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:57.857134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:57.857951 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:57.857951 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:57.857951 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:57.857951 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:57.857951 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:52:57.857951 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:52:57.857951 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:52:57.857951 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:52:57.857951 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:52:57.857951 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:52:57.857951 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:52:57.857951 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:57.857951 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 402/808] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 27 18:52:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:57.857951 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a7028-1d14-49e4-ba6a-e938ad8b3394 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:57.858689 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a7028-1d14-49e4-ba6a-e938ad8b3394 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:57.858689 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a7028-1d14-49e4-ba6a-e938ad8b3394 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:57.859771 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 403/809] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:52:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:52:57.862197 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a7028-1d14-49e4-ba6a-e938ad8b3394 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:57.871002 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:57.968697 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a7028-1d14-49e4-ba6a-e938ad8b3394 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:57.972212 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c3d0ec-8343-4d71-8125-974ae4eed7c8 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:58.003333 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d31eaa2-61fa-473f-8e8a-a47bfc9cea11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:58.004119 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31eaa2-61fa-473f-8e8a-a47bfc9cea11 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:58.004470 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31eaa2-61fa-473f-8e8a-a47bfc9cea11 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:58.004803 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31eaa2-61fa-473f-8e8a-a47bfc9cea11 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:58.005515 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d31eaa2-61fa-473f-8e8a-a47bfc9cea11 None admin] RBAC: Adding query filter params (name=service) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:58.005816 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d31eaa2-61fa-473f-8e8a-a47bfc9cea11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:58.007676 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d31eaa2-61fa-473f-8e8a-a47bfc9cea11 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:58.009658 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a94e580-d4b2-452e-9cc8-a71900cd06e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:58.010390 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94e580-d4b2-452e-9cc8-a71900cd06e3 None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:58.010739 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94e580-d4b2-452e-9cc8-a71900cd06e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:58.011081 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94e580-d4b2-452e-9cc8-a71900cd06e3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:58.011887 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a94e580-d4b2-452e-9cc8-a71900cd06e3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:58.013361 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a94e580-d4b2-452e-9cc8-a71900cd06e3 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:58.013679 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:58.022090 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 404/810] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Jul 27 18:52:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:52:58.024017 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6874e-02e1-43d2-84f0-37d3869e2932 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:58.024364 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6874e-02e1-43d2-84f0-37d3869e2932 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:58.024699 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6874e-02e1-43d2-84f0-37d3869e2932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:58.047716 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 407/811] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Jul 27 18:52:57 2022] POST /identity/v3/endpoints => generated 346 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:52:58.047716 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a94e580-d4b2-452e-9cc8-a71900cd06e3 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:58.055235 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-f7a6874e-02e1-43d2-84f0-37d3869e2932 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:58.056579 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-f7a6874e-02e1-43d2-84f0-37d3869e2932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:58.130878 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:58.155128 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 405/812] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:52:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:52:58.156034 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6874e-02e1-43d2-84f0-37d3869e2932 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:58.189344 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a94e580-d4b2-452e-9cc8-a71900cd06e3 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:58.240236 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d857855b-d276-424d-b976-039bbea75895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:58.241115 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857855b-d276-424d-b976-039bbea75895 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:58.241395 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857855b-d276-424d-b976-039bbea75895 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:58.242184 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857855b-d276-424d-b976-039bbea75895 None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:58.243289 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d857855b-d276-424d-b976-039bbea75895 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:58.243397 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d857855b-d276-424d-b976-039bbea75895 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:58.245501 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d857855b-d276-424d-b976-039bbea75895 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:58.267404 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 408/813] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Jul 27 18:52:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:58.268140 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d857855b-d276-424d-b976-039bbea75895 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:58.293359 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6874e-02e1-43d2-84f0-37d3869e2932 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:58.322870 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:58.333506 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8eb9b7-b819-4141-b727-0b0049564c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:58.334151 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8eb9b7-b819-4141-b727-0b0049564c5b None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:58.334431 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8eb9b7-b819-4141-b727-0b0049564c5b None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:58.334707 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8eb9b7-b819-4141-b727-0b0049564c5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:58.345061 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8eb9b7-b819-4141-b727-0b0049564c5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:58.346310 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8eb9b7-b819-4141-b727-0b0049564c5b None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:58.361625 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-fb8eb9b7-b819-4141-b727-0b0049564c5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:58.361625 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:58.361625 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:58.361625 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:58.361625 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:58.361625 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:58.361625 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:58.361625 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:58.361625 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:58.361625 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:58.361625 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:58.361625 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:58.361625 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:52:58.361625 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:52:58.361625 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:52:58.362564 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:52:58.362564 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:58.362564 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:58.362564 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:58.362564 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:58.362564 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:58.362564 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:58.362564 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:58.362564 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:58.362564 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:58.362564 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:58.362564 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:58.362564 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:58.362564 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:58.362564 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:58.362564 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:58.362564 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:58.363442 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:52:58.363442 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:52:58.363442 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:58.363442 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:58.363442 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 406/814] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:52:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:58.364170 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8eb9b7-b819-4141-b727-0b0049564c5b None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:58.399546 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d857855b-d276-424d-b976-039bbea75895 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:58.421375 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:58.438136 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f1d25-29c1-4200-bd80-01172c777423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:58.439219 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f1d25-29c1-4200-bd80-01172c777423 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:58.439792 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f1d25-29c1-4200-bd80-01172c777423 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:58.440309 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f1d25-29c1-4200-bd80-01172c777423 None admin] PATH_INFO: `/v3/services/network` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:58.441151 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499f1d25-29c1-4200-bd80-01172c777423 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:58.442713 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499f1d25-29c1-4200-bd80-01172c777423 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:58.453378 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-499f1d25-29c1-4200-bd80-01172c777423 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 18:52:58.453378 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:58.453378 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:52:58.453378 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:52:58.453378 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:52:58.453378 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:52:58.453378 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:52:58.453378 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:52:58.453378 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 18:52:58.453378 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:58.453378 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:52:58.453378 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:58.453378 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:58.453378 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:58.453378 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:58.453378 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:58.453378 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:58.454374 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:58.454374 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:58.454374 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:58.454374 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:58.454374 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:58.454374 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:58.454374 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:52:58.454374 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:52:58.454374 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:52:58.454374 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:52:58.454374 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:58.454374 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:58.454374 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:58.454374 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:58.454374 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:58.454374 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:58.455202 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:58.455202 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:58.455202 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:58.455202 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:58.455202 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:58.455202 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:58.455202 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:58.455202 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:58.455202 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:58.455202 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:58.455202 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:52:58.455202 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:52:58.455202 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 18:52:58.455202 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:58.457976 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 409/815] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 27 18:52:58 2022] GET /identity/v3/services/network => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:58.459013 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f1d25-29c1-4200-bd80-01172c777423 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:58.470063 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8eb9b7-b819-4141-b727-0b0049564c5b None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:58.505264 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dec0f4-48bc-440b-8380-2abf4e1f6ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:58.505786 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dec0f4-48bc-440b-8380-2abf4e1f6ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:58.506067 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dec0f4-48bc-440b-8380-2abf4e1f6ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:58.506338 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dec0f4-48bc-440b-8380-2abf4e1f6ee9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:58.560177 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:58.568109 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f1d25-29c1-4200-bd80-01172c777423 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:58.576612 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dec0f4-48bc-440b-8380-2abf4e1f6ee9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:58.578127 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dec0f4-48bc-440b-8380-2abf4e1f6ee9 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:58.604550 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917968c5-3964-41e1-8586-751837630c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:58.605526 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917968c5-3964-41e1-8586-751837630c80 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:58.606001 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917968c5-3964-41e1-8586-751837630c80 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:58.606465 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917968c5-3964-41e1-8586-751837630c80 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:58.607337 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917968c5-3964-41e1-8586-751837630c80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:58.607862 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917968c5-3964-41e1-8586-751837630c80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:58.609440 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917968c5-3964-41e1-8586-751837630c80 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:58.623050 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 410/816] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:52:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:58.624192 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917968c5-3964-41e1-8586-751837630c80 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:58.672269 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:58.685763 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 407/817] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 27 18:52:58 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 18:52:58.686657 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dec0f4-48bc-440b-8380-2abf4e1f6ee9 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:58.730695 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917968c5-3964-41e1-8586-751837630c80 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:58.766613 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10fee7-71dd-4960-8b15-8f670c9bbeaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:58.767580 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10fee7-71dd-4960-8b15-8f670c9bbeaf None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:58.768097 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10fee7-71dd-4960-8b15-8f670c9bbeaf None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:58.768201 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:58.768676 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10fee7-71dd-4960-8b15-8f670c9bbeaf None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:58.769536 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f10fee7-71dd-4960-8b15-8f670c9bbeaf None admin] RBAC: Adding query filter params (name=network) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:58.770030 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f10fee7-71dd-4960-8b15-8f670c9bbeaf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:58.771569 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f10fee7-71dd-4960-8b15-8f670c9bbeaf None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:58.780814 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 411/818] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Jul 27 18:52:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:58.781988 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10fee7-71dd-4960-8b15-8f670c9bbeaf None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:58.787244 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dec0f4-48bc-440b-8380-2abf4e1f6ee9 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:58.822596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94767397-bcda-4469-95a4-42a6b8d597a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:58.823237 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94767397-bcda-4469-95a4-42a6b8d597a5 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:58.823516 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94767397-bcda-4469-95a4-42a6b8d597a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:58.823819 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94767397-bcda-4469-95a4-42a6b8d597a5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:58.831309 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94767397-bcda-4469-95a4-42a6b8d597a5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:58.832842 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94767397-bcda-4469-95a4-42a6b8d597a5 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:58.845962 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-94767397-bcda-4469-95a4-42a6b8d597a5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 18:52:58.845962 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:58.845962 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:58.845962 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:58.845962 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:58.845962 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:58.845962 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:58.845962 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:58.845962 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:58.845962 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:58.845962 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:58.845962 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:58.845962 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:52:58.845962 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:52:58.845962 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:52:58.845962 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:52:58.846988 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:58.846988 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:58.846988 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:52:58.846988 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:52:58.846988 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:52:58.846988 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:52:58.846988 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:58.846988 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:58.846988 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:58.846988 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:58.846988 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:58.846988 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:58.846988 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:58.846988 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:58.846988 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:58.846988 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:58.846988 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:58.846988 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:58.847939 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:58.847939 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:58.847939 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:52:58.847939 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:52:58.847939 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:52:58.847939 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:52:58.847939 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:52:58.847939 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:52:58.847939 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 18:52:58.847939 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:58.847939 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 408/819] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Jul 27 18:52:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:58.848519 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94767397-bcda-4469-95a4-42a6b8d597a5 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:58.898233 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10fee7-71dd-4960-8b15-8f670c9bbeaf None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:58.924235 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:58.936977 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b757a9-af4b-4f47-9a62-4224290c52f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:58.937879 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b757a9-af4b-4f47-9a62-4224290c52f3 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:58.938364 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b757a9-af4b-4f47-9a62-4224290c52f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:58.938918 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b757a9-af4b-4f47-9a62-4224290c52f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:58.950178 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b757a9-af4b-4f47-9a62-4224290c52f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:58.950944 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94767397-bcda-4469-95a4-42a6b8d597a5 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:58.952156 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b757a9-af4b-4f47-9a62-4224290c52f3 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:58.968386 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-40b757a9-af4b-4f47-9a62-4224290c52f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:58.968386 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:58.968386 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:58.968386 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:58.968386 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:58.968386 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:58.968386 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:58.968386 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:58.968386 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:58.968386 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:58.968386 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:58.968386 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:58.968386 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:52:58.968386 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:52:58.968386 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:52:58.969332 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:52:58.969332 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:58.969332 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:58.969332 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:58.969332 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:58.969332 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:58.969332 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:58.969332 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:58.969332 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:58.969332 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:58.969332 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:58.969332 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:58.969332 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:58.969332 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:58.969332 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:58.969332 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:58.969332 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:58.970206 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:52:58.970206 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:52:58.970206 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:58.970206 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:58.976495 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 412/820] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:52:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:58.977618 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b757a9-af4b-4f47-9a62-4224290c52f3 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:58.986338 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f3a5cd-6272-434a-ac7d-3ae090821b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:58.986951 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3a5cd-6272-434a-ac7d-3ae090821b78 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:58.987232 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3a5cd-6272-434a-ac7d-3ae090821b78 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:58.987505 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3a5cd-6272-434a-ac7d-3ae090821b78 None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:58.988216 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f3a5cd-6272-434a-ac7d-3ae090821b78 None admin] RBAC: Adding query filter params (type=network) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:58.988523 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f3a5cd-6272-434a-ac7d-3ae090821b78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:58.989883 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f3a5cd-6272-434a-ac7d-3ae090821b78 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:58.999776 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 409/821] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Jul 27 18:52:58 2022] GET /identity/v3/services?type=network => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:58.999776 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f3a5cd-6272-434a-ac7d-3ae090821b78 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:59.000362 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:59.094139 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b757a9-af4b-4f47-9a62-4224290c52f3 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:59.102150 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f3a5cd-6272-434a-ac7d-3ae090821b78 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:59.131078 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020f8de-3107-4c48-97bf-316a87e57d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:59.132153 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020f8de-3107-4c48-97bf-316a87e57d29 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:59.132749 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020f8de-3107-4c48-97bf-316a87e57d29 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:59.133233 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020f8de-3107-4c48-97bf-316a87e57d29 None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:59.134211 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d020f8de-3107-4c48-97bf-316a87e57d29 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:59.134798 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d020f8de-3107-4c48-97bf-316a87e57d29 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:59.136735 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d020f8de-3107-4c48-97bf-316a87e57d29 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:59.137545 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5095cf-f6b7-4922-a612-c0ddaeae9da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:59.138156 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5095cf-f6b7-4922-a612-c0ddaeae9da2 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:59.138435 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5095cf-f6b7-4922-a612-c0ddaeae9da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:59.138704 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5095cf-f6b7-4922-a612-c0ddaeae9da2 None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:59.139501 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5095cf-f6b7-4922-a612-c0ddaeae9da2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:59.139843 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5095cf-f6b7-4922-a612-c0ddaeae9da2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:59.141432 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5095cf-f6b7-4922-a612-c0ddaeae9da2 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:59.158703 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 410/822] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:52:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:59.158703 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5095cf-f6b7-4922-a612-c0ddaeae9da2 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:59.162594 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 413/823] 10.222.0.20 () {56 vars in 1149 bytes} [Wed Jul 27 18:52:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:59.164023 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020f8de-3107-4c48-97bf-316a87e57d29 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:59.185447 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:59.221417 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:59.267061 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5095cf-f6b7-4922-a612-c0ddaeae9da2 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:59.280399 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020f8de-3107-4c48-97bf-316a87e57d29 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:59.306669 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a811ea96-0af6-4ce1-a986-a09003296ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:59.307361 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811ea96-0af6-4ce1-a986-a09003296ea9 None admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:59.307574 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811ea96-0af6-4ce1-a986-a09003296ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:59.307882 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811ea96-0af6-4ce1-a986-a09003296ea9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:59.308600 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a811ea96-0af6-4ce1-a986-a09003296ea9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:59.310130 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a811ea96-0af6-4ce1-a986-a09003296ea9 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:59.320707 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518420c-2a3b-4a4c-a087-06fb9c77131e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:59.321792 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518420c-2a3b-4a4c-a087-06fb9c77131e None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:59.322268 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518420c-2a3b-4a4c-a087-06fb9c77131e None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:59.322828 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518420c-2a3b-4a4c-a087-06fb9c77131e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:59.331006 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6518420c-2a3b-4a4c-a087-06fb9c77131e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:59.332814 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6518420c-2a3b-4a4c-a087-06fb9c77131e None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:59.339790 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 411/824] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Jul 27 18:52:59 2022] POST /identity/v3/endpoints => generated 327 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:52:59.339790 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a811ea96-0af6-4ce1-a986-a09003296ea9 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:59.359854 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-6518420c-2a3b-4a4c-a087-06fb9c77131e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:52:59.359854 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:59.359854 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:59.359854 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:59.359854 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:59.359854 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:59.359854 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:59.359854 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:59.359854 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:59.359854 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:59.359854 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:59.359854 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:59.359854 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:52:59.359854 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:52:59.359854 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:52:59.361077 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:52:59.361077 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:59.361077 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:59.361077 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:59.361077 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:59.361077 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:59.361077 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:59.361077 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:59.361077 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:59.361077 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:59.361077 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:59.361077 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:59.361077 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:59.361077 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:59.361077 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:59.361077 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:59.361077 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:59.361961 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:52:59.361961 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:52:59.361961 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:52:59.361961 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:52:59.361961 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:52:59.361961 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:52:59.361961 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:52:59.361961 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:52:59.364804 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 414/825] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 27 18:52:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:59.370835 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518420c-2a3b-4a4c-a087-06fb9c77131e None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:59.455963 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a811ea96-0af6-4ce1-a986-a09003296ea9 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:59.472629 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:59.495952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9924206-809a-48f0-aa0d-567ff4fae1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:59.496598 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9924206-809a-48f0-aa0d-567ff4fae1df None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:59.496878 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9924206-809a-48f0-aa0d-567ff4fae1df None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:59.497154 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9924206-809a-48f0-aa0d-567ff4fae1df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:59.508789 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:59.511273 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9924206-809a-48f0-aa0d-567ff4fae1df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:59.513263 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9924206-809a-48f0-aa0d-567ff4fae1df None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:59.532674 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-d9924206-809a-48f0-aa0d-567ff4fae1df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:59.532674 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:59.532674 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:59.532674 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:59.532674 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:59.532674 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:59.532674 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:59.532674 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:59.532674 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:59.532674 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:59.532674 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:59.532674 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:59.532674 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:52:59.532674 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:52:59.532674 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:52:59.533868 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:52:59.533868 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:59.533868 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:59.533868 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:59.533868 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:59.533868 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:59.533868 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:59.533868 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:59.533868 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:59.533868 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:59.533868 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:59.533868 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:59.533868 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:59.533868 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:59.533868 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:59.533868 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:59.533868 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:59.534956 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:52:59.534956 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:52:59.534956 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:52:59.534956 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:52:59.536352 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518420c-2a3b-4a4c-a087-06fb9c77131e None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:59.537544 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 412/826] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:52:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:52:59.544751 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9924206-809a-48f0-aa0d-567ff4fae1df None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:59.577383 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb5c24-916d-413f-951c-66aa5158f6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:59.578006 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb5c24-916d-413f-951c-66aa5158f6f3 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:59.578284 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb5c24-916d-413f-951c-66aa5158f6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:59.578552 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb5c24-916d-413f-951c-66aa5158f6f3 None admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:59.579518 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceb5c24-916d-413f-951c-66aa5158f6f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:59.581165 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceb5c24-916d-413f-951c-66aa5158f6f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:59.582254 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceb5c24-916d-413f-951c-66aa5158f6f3 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:59.609914 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 415/827] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 27 18:52:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:52:59.618116 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb5c24-916d-413f-951c-66aa5158f6f3 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:59.712892 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9924206-809a-48f0-aa0d-567ff4fae1df None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:59.744068 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb5c24-916d-413f-951c-66aa5158f6f3 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:59.751226 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a6520-1b6a-41e3-8b87-ec56d00c7c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:59.752262 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a6520-1b6a-41e3-8b87-ec56d00c7c1c None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:59.752747 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a6520-1b6a-41e3-8b87-ec56d00c7c1c None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:59.753217 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a6520-1b6a-41e3-8b87-ec56d00c7c1c None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:59.754218 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2a6520-1b6a-41e3-8b87-ec56d00c7c1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:59.754758 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2a6520-1b6a-41e3-8b87-ec56d00c7c1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:59.757950 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2a6520-1b6a-41e3-8b87-ec56d00c7c1c None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:59.772574 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 413/828] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:52:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:59.778594 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a6520-1b6a-41e3-8b87-ec56d00c7c1c None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:59.780374 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d38e3e-de74-4efb-b905-6b4711b629a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:59.780984 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d38e3e-de74-4efb-b905-6b4711b629a0 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:59.781262 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d38e3e-de74-4efb-b905-6b4711b629a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:59.781531 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d38e3e-de74-4efb-b905-6b4711b629a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:59.782456 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d38e3e-de74-4efb-b905-6b4711b629a0 None admin] RBAC: Adding query filter params (role.id=0f4a39b061e148418413cfe647af9a34, scope.project.id=31f027c53398443eb548eaf3f24523e0, user.id=17fbef9db7734283aaad4962ee160171) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:52:59.782723 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d38e3e-de74-4efb-b905-6b4711b629a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:59.784471 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d38e3e-de74-4efb-b905-6b4711b629a0 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:59.790962 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 416/829] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 27 18:52:59 2022] GET /identity/v3/role_assignments?user.id=17fbef9db7734283aaad4962ee160171&scope.project.id=31f027c53398443eb548eaf3f24523e0&role.id=0f4a39b061e148418413cfe647af9a34 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:52:59.794123 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4645b67-cea4-427a-bc01-038bfdc69154 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:59.794414 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4645b67-cea4-427a-bc01-038bfdc69154 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:59.794771 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4645b67-cea4-427a-bc01-038bfdc69154 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:59.796403 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 417/830] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:52:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:52:59.802505 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee9594-24b3-4af2-877b-a1993058dc69 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:59.802505 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee9594-24b3-4af2-877b-a1993058dc69 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:59.802791 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee9594-24b3-4af2-877b-a1993058dc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:59.810731 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:59.815189 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:59.827821 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-b3ee9594-24b3-4af2-877b-a1993058dc69 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:52:59.829518 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-b3ee9594-24b3-4af2-877b-a1993058dc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:59.927726 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a6520-1b6a-41e3-8b87-ec56d00c7c1c None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:59.927919 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 418/831] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:52:59 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 18:52:59.962038 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee9594-24b3-4af2-877b-a1993058dc69 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:59.968867 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c84a8-1a66-4c8c-9358-c5db5482dc2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:59.969826 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c84a8-1a66-4c8c-9358-c5db5482dc2c None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:59.970327 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c84a8-1a66-4c8c-9358-c5db5482dc2c None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:59.970885 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c84a8-1a66-4c8c-9358-c5db5482dc2c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:59.979903 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231c84a8-1a66-4c8c-9358-c5db5482dc2c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:59.981904 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231c84a8-1a66-4c8c-9358-c5db5482dc2c None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:59.996732 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-231c84a8-1a66-4c8c-9358-c5db5482dc2c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:52:59.996732 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:52:59.996732 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:52:59.996732 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:52:59.996732 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:52:59.996732 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:52:59.996732 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:52:59.996732 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:52:59.996732 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:52:59.996732 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:52:59.996732 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:52:59.996732 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:52:59.996732 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:52:59.996732 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:52:59.996732 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:52:59.997682 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:52:59.997682 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:52:59.997682 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:52:59.997682 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:52:59.997682 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:52:59.997682 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:52:59.997682 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:52:59.997682 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:52:59.997682 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:52:59.997682 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:52:59.997682 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:52:59.997682 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:52:59.997682 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:52:59.997682 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:52:59.997682 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:52:59.997682 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:52:59.997682 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:52:59.998556 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:52:59.998556 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:52:59.998556 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:52:59.998556 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:52:59.998556 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:52:59.998556 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:52:59.998556 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:52:59.998556 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:53:00.000665 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 414/832] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 27 18:52:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:53:00.006856 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c84a8-1a66-4c8c-9358-c5db5482dc2c None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:00.100432 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee9594-24b3-4af2-877b-a1993058dc69 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:00.118227 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:00.135876 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c84a8-1a66-4c8c-9358-c5db5482dc2c None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:00.142413 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:00.150019 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eeb4c9-69b0-443c-8d4c-a5b59571cf14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:00.150917 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eeb4c9-69b0-443c-8d4c-a5b59571cf14 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:00.151205 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eeb4c9-69b0-443c-8d4c-a5b59571cf14 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:00.151482 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eeb4c9-69b0-443c-8d4c-a5b59571cf14 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:00.167001 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eeb4c9-69b0-443c-8d4c-a5b59571cf14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:53:00.173330 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-59eeb4c9-69b0-443c-8d4c-a5b59571cf14 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:53:00.173330 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:00.173330 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:00.173330 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:00.173330 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:00.173330 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:00.173330 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:00.173330 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:00.173330 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:00.173330 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:00.173330 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:00.173330 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:00.173330 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:53:00.173330 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:53:00.173330 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:53:00.173330 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:53:00.174376 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:53:00.174376 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:53:00.174376 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:53:00.174376 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:53:00.174376 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:00.174376 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:00.174376 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:00.174376 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:00.174376 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:00.174376 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:00.174376 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:00.174376 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:00.174376 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:00.174376 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:00.174376 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:00.174376 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:00.175361 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:00.175361 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:00.175361 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:00.175361 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:00.175361 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:53:00.175361 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:53:00.175361 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:53:00.175361 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:53:00.175361 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:53:00.175361 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:53:00.175361 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:53:00.175361 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:00.175361 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 419/833] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 27 18:52:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:53:00.177093 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4a9a29-63a6-4a28-af88-354cebde8d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:00.177791 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a9a29-63a6-4a28-af88-354cebde8d66 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:00.178139 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a9a29-63a6-4a28-af88-354cebde8d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:00.178490 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a9a29-63a6-4a28-af88-354cebde8d66 None admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:00.180173 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4a9a29-63a6-4a28-af88-354cebde8d66 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:00.180549 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4a9a29-63a6-4a28-af88-354cebde8d66 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:00.181132 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eeb4c9-69b0-443c-8d4c-a5b59571cf14 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:00.182187 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4a9a29-63a6-4a28-af88-354cebde8d66 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:00.195940 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 415/834] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 27 18:53:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:00.204601 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4a9a29-63a6-4a28-af88-354cebde8d66 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:00.297367 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eeb4c9-69b0-443c-8d4c-a5b59571cf14 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:00.322723 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4a9a29-63a6-4a28-af88-354cebde8d66 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:00.332737 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32feda6e-e076-4ab4-87cf-08c3ac2033e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:00.333345 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32feda6e-e076-4ab4-87cf-08c3ac2033e6 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:00.333621 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32feda6e-e076-4ab4-87cf-08c3ac2033e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:00.333888 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32feda6e-e076-4ab4-87cf-08c3ac2033e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:00.334596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32feda6e-e076-4ab4-87cf-08c3ac2033e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:00.334898 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32feda6e-e076-4ab4-87cf-08c3ac2033e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:00.336269 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32feda6e-e076-4ab4-87cf-08c3ac2033e6 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:00.344194 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 420/835] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 27 18:53:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:53:00.345345 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5767876-66f1-4e5b-b7cd-8eedab03a636 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:00.345625 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5767876-66f1-4e5b-b7cd-8eedab03a636 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:00.345897 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5767876-66f1-4e5b-b7cd-8eedab03a636 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:00.347730 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 421/836] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:53:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:53:00.349532 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5767876-66f1-4e5b-b7cd-8eedab03a636 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:00.368804 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a79a2f6-3e51-4aa9-99a3-379b1098b731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:00.369510 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79a2f6-3e51-4aa9-99a3-379b1098b731 None admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:00.369798 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79a2f6-3e51-4aa9-99a3-379b1098b731 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:00.370068 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79a2f6-3e51-4aa9-99a3-379b1098b731 None admin] PATH_INFO: `/v3/projects/31f027c53398443eb548eaf3f24523e0/users/a277ddae777442869114c4c5deff7d7e/roles/306da3282d854292a7a53b8642ee373b` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:00.386744 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a79a2f6-3e51-4aa9-99a3-379b1098b731 None admin] RBAC: Authorizing `identity:create_grant(project_id=31f027c53398443eb548eaf3f24523e0, user_id=a277ddae777442869114c4c5deff7d7e, role_id=306da3282d854292a7a53b8642ee373b)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:00.388218 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a79a2f6-3e51-4aa9-99a3-379b1098b731 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:00.391213 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:00.404255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 416/837] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 27 18:53:00 2022] PUT /identity/v3/projects/31f027c53398443eb548eaf3f24523e0/users/a277ddae777442869114c4c5deff7d7e/roles/306da3282d854292a7a53b8642ee373b => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:53:00.405475 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90cf966-7dea-4278-9c65-feb33df0eadf None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:00.405741 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90cf966-7dea-4278-9c65-feb33df0eadf None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:00.406005 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90cf966-7dea-4278-9c65-feb33df0eadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:00.425026 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-d90cf966-7dea-4278-9c65-feb33df0eadf None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:53:00.426031 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:00.426273 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-d90cf966-7dea-4278-9c65-feb33df0eadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:00.507558 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5767876-66f1-4e5b-b7cd-8eedab03a636 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:00.516325 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 417/838] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:53:00 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:53:00.545592 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90cf966-7dea-4278-9c65-feb33df0eadf None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:00.568570 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c6ec1-5f0e-4586-82c7-3be55c7c8115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:00.569567 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c6ec1-5f0e-4586-82c7-3be55c7c8115 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:00.569971 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c6ec1-5f0e-4586-82c7-3be55c7c8115 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:00.570360 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c6ec1-5f0e-4586-82c7-3be55c7c8115 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:00.589561 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c6ec1-5f0e-4586-82c7-3be55c7c8115 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:00.592137 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c6ec1-5f0e-4586-82c7-3be55c7c8115 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:00.614222 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-c34c6ec1-5f0e-4586-82c7-3be55c7c8115 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:53:00.614222 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:00.614222 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:00.614222 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:00.614222 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:00.614222 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:00.614222 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:00.614222 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:00.614222 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:00.614222 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:00.614222 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:00.614222 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:00.614222 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:53:00.614222 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:53:00.614222 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:53:00.615183 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:53:00.615183 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:00.615183 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:00.615183 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:00.615183 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:00.615183 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:00.615183 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:00.615183 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:00.615183 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:00.615183 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:00.615183 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:00.615183 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:00.615183 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:00.615183 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:00.615183 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:00.615183 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:00.615183 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:00.616129 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:53:00.616129 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:53:00.616129 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:53:00.616129 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:00.616129 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 422/839] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:53:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:53:00.620815 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c6ec1-5f0e-4586-82c7-3be55c7c8115 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:00.675524 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90cf966-7dea-4278-9c65-feb33df0eadf None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:00.703759 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:00.715215 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85da0d-8ef4-4da9-b5f5-d0ad00678baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:00.716269 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85da0d-8ef4-4da9-b5f5-d0ad00678baf None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:00.716758 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85da0d-8ef4-4da9-b5f5-d0ad00678baf None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:00.717282 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85da0d-8ef4-4da9-b5f5-d0ad00678baf None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:00.718219 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff85da0d-8ef4-4da9-b5f5-d0ad00678baf None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:00.719832 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff85da0d-8ef4-4da9-b5f5-d0ad00678baf None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:00.730358 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-ff85da0d-8ef4-4da9-b5f5-d0ad00678baf None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 18:53:00.730358 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:00.730358 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:53:00.730358 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:53:00.730358 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:53:00.730358 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:53:00.730358 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:53:00.730358 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:53:00.730358 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 18:53:00.730358 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:53:00.730358 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:53:00.730358 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:53:00.730358 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:00.730358 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:00.730358 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:00.730358 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:00.730358 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:00.731346 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:00.731346 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:00.731346 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:00.731346 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:00.731346 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:00.731346 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:00.731346 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:53:00.731346 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:53:00.731346 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:53:00.731346 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:53:00.731346 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:00.731346 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:00.731346 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:00.731346 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:00.731346 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:00.731346 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:00.732247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:00.732247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:00.732247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:00.732247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:00.732247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:00.732247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:00.732247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:00.732247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:00.732247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:00.732247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:00.732247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:53:00.732247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:53:00.732247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 18:53:00.732247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:53:00.734712 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c6ec1-5f0e-4586-82c7-3be55c7c8115 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:00.735472 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 418/840] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 27 18:53:00 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:53:00.741575 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85da0d-8ef4-4da9-b5f5-d0ad00678baf None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:00.742145 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:00.772132 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71756c4-b86c-4f15-a23b-db74814b13d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:00.773274 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71756c4-b86c-4f15-a23b-db74814b13d2 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:00.773558 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71756c4-b86c-4f15-a23b-db74814b13d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:00.773822 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71756c4-b86c-4f15-a23b-db74814b13d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:00.774731 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71756c4-b86c-4f15-a23b-db74814b13d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:00.775043 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71756c4-b86c-4f15-a23b-db74814b13d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:00.776516 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71756c4-b86c-4f15-a23b-db74814b13d2 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:00.789347 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 423/841] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:53:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:53:00.794870 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71756c4-b86c-4f15-a23b-db74814b13d2 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:00.855866 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85da0d-8ef4-4da9-b5f5-d0ad00678baf None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:00.896464 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f676a-102f-44d6-b9c9-6c2d7304ccee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:00.898429 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f676a-102f-44d6-b9c9-6c2d7304ccee None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:00.899754 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f676a-102f-44d6-b9c9-6c2d7304ccee None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:00.900869 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f676a-102f-44d6-b9c9-6c2d7304ccee None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:00.902216 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5f676a-102f-44d6-b9c9-6c2d7304ccee None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:00.902753 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5f676a-102f-44d6-b9c9-6c2d7304ccee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:00.904379 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5f676a-102f-44d6-b9c9-6c2d7304ccee None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:00.919113 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 419/842] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 27 18:53:00 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:53:00.920233 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f676a-102f-44d6-b9c9-6c2d7304ccee None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:00.930160 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71756c4-b86c-4f15-a23b-db74814b13d2 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:00.976912 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c0595-183d-4c1d-8f9e-ecdbfcd768be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:00.978336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c0595-183d-4c1d-8f9e-ecdbfcd768be None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:00.978801 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c0595-183d-4c1d-8f9e-ecdbfcd768be None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:00.979225 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c0595-183d-4c1d-8f9e-ecdbfcd768be None admin] PATH_INFO: `/v3/users/swift` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:00.981156 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:00.992162 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171c0595-183d-4c1d-8f9e-ecdbfcd768be None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:00.994285 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171c0595-183d-4c1d-8f9e-ecdbfcd768be None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:01.010393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-171c0595-183d-4c1d-8f9e-ecdbfcd768be None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 18:53:01.010393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:01.010393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:01.010393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:01.010393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:01.010393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:01.010393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:01.010393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:01.010393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:01.010393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:01.010393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:01.010393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:01.010393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:53:01.010393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:53:01.010393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:53:01.010393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:53:01.011592 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:01.011592 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:01.011592 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:53:01.011592 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:53:01.011592 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:53:01.011592 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:53:01.011592 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:01.011592 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:01.011592 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:01.011592 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:01.011592 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:01.011592 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:01.011592 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:01.011592 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:01.011592 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:01.011592 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:01.011592 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:01.011592 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:01.012575 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:01.012575 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:01.012575 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:53:01.012575 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:53:01.012575 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:53:01.012575 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:53:01.012575 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:53:01.012575 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:53:01.012575 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 18:53:01.012575 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:01.015768 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 424/843] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 27 18:53:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:53:01.018843 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c0595-183d-4c1d-8f9e-ecdbfcd768be None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:01.037484 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f676a-102f-44d6-b9c9-6c2d7304ccee None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:01.058017 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:01.074974 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e418c-6cc0-4177-bd61-98749fc9e735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:01.075595 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e418c-6cc0-4177-bd61-98749fc9e735 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:01.075934 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e418c-6cc0-4177-bd61-98749fc9e735 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:01.076175 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e418c-6cc0-4177-bd61-98749fc9e735 None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:01.076854 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41e418c-6cc0-4177-bd61-98749fc9e735 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:01.077313 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41e418c-6cc0-4177-bd61-98749fc9e735 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:01.078724 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41e418c-6cc0-4177-bd61-98749fc9e735 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:01.088509 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 420/844] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 27 18:53:00 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:53:01.152848 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c0595-183d-4c1d-8f9e-ecdbfcd768be None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:01.190151 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d437b52-e569-4f10-8068-330cda2eabb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:01.190776 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d437b52-e569-4f10-8068-330cda2eabb6 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:01.191054 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d437b52-e569-4f10-8068-330cda2eabb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:01.191326 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d437b52-e569-4f10-8068-330cda2eabb6 None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:01.192175 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d437b52-e569-4f10-8068-330cda2eabb6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:01.192486 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d437b52-e569-4f10-8068-330cda2eabb6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:01.193912 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d437b52-e569-4f10-8068-330cda2eabb6 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:01.215113 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 425/845] 10.222.0.20 () {56 vars in 1135 bytes} [Wed Jul 27 18:53:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:01.220682 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e418c-6cc0-4177-bd61-98749fc9e735 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:01.336154 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e418c-6cc0-4177-bd61-98749fc9e735 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:01.353423 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:01.371805 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8117f-706c-45c3-bf0f-3f768230a820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:01.372417 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8117f-706c-45c3-bf0f-3f768230a820 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:01.372693 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8117f-706c-45c3-bf0f-3f768230a820 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:01.372966 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8117f-706c-45c3-bf0f-3f768230a820 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:01.441266 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec8117f-706c-45c3-bf0f-3f768230a820 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:01.442698 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec8117f-706c-45c3-bf0f-3f768230a820 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:01.550414 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 421/846] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 27 18:53:01 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 18:53:01.556308 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d437b52-e569-4f10-8068-330cda2eabb6 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:01.649691 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:01.667036 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d437b52-e569-4f10-8068-330cda2eabb6 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:01.701863 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b70cd-4da0-4bc5-a17f-06b8c4db912c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:01.702425 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b70cd-4da0-4bc5-a17f-06b8c4db912c None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:01.702704 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b70cd-4da0-4bc5-a17f-06b8c4db912c None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:01.702978 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b70cd-4da0-4bc5-a17f-06b8c4db912c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:01.714025 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742b70cd-4da0-4bc5-a17f-06b8c4db912c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:01.715453 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742b70cd-4da0-4bc5-a17f-06b8c4db912c None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:01.730798 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-742b70cd-4da0-4bc5-a17f-06b8c4db912c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:53:01.730798 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:01.730798 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:01.730798 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:01.730798 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:01.730798 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:01.730798 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:01.730798 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:01.730798 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:01.730798 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:01.730798 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:01.730798 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:01.730798 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:53:01.730798 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:53:01.730798 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:53:01.731767 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:53:01.731767 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:01.731767 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:01.731767 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:01.731767 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:01.731767 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:01.731767 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:01.731767 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:01.731767 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:01.731767 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:01.731767 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:01.731767 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:01.731767 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:01.731767 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:01.731767 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:01.731767 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:01.731767 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:01.732671 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:53:01.732671 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:53:01.732671 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:53:01.732671 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:01.732671 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 426/847] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:53:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:53:01.739617 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8117f-706c-45c3-bf0f-3f768230a820 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:01.775994 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:01.841581 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8117f-706c-45c3-bf0f-3f768230a820 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:01.876007 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ae838-f40b-4316-b4a9-ea8ba52df90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:01.876618 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ae838-f40b-4316-b4a9-ea8ba52df90b None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:01.876900 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ae838-f40b-4316-b4a9-ea8ba52df90b None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:01.877171 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ae838-f40b-4316-b4a9-ea8ba52df90b None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:01.877865 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830ae838-f40b-4316-b4a9-ea8ba52df90b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:01.878169 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830ae838-f40b-4316-b4a9-ea8ba52df90b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:01.879532 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830ae838-f40b-4316-b4a9-ea8ba52df90b None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:01.892023 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 422/848] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:53:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:01.898276 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b70cd-4da0-4bc5-a17f-06b8c4db912c None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:01.960275 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb375b12-c485-4f13-8c1a-539130415009 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:01.960592 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb375b12-c485-4f13-8c1a-539130415009 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:01.960758 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb375b12-c485-4f13-8c1a-539130415009 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:01.962510 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 423/849] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:53:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:53:01.967852 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b66424-ef04-47bc-af40-e07aad4435b5 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:01.968313 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b66424-ef04-47bc-af40-e07aad4435b5 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:01.968661 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b66424-ef04-47bc-af40-e07aad4435b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:01.992413 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-81b66424-ef04-47bc-af40-e07aad4435b5 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:53:01.993881 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-81b66424-ef04-47bc-af40-e07aad4435b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:02.007109 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b70cd-4da0-4bc5-a17f-06b8c4db912c None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:02.043089 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32115831-3e36-40d4-9741-d9741dc74bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:02.043741 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32115831-3e36-40d4-9741-d9741dc74bf1 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:02.044023 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32115831-3e36-40d4-9741-d9741dc74bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:02.044297 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32115831-3e36-40d4-9741-d9741dc74bf1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:02.047844 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:02.054984 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32115831-3e36-40d4-9741-d9741dc74bf1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:02.057125 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32115831-3e36-40d4-9741-d9741dc74bf1 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:02.072181 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-32115831-3e36-40d4-9741-d9741dc74bf1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:53:02.072181 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:02.072181 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:02.072181 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:02.072181 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:02.072181 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:02.072181 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:02.072181 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:02.072181 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:02.072181 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:02.072181 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:02.072181 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:02.072181 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:53:02.072181 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:53:02.072181 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:53:02.073276 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:53:02.073276 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:02.073276 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:02.073276 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:02.073276 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:02.073276 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:02.073276 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:02.073276 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:02.073276 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:02.073276 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:02.073276 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:02.073276 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:02.073276 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:02.073276 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:02.073276 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:02.073276 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:02.073276 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:02.074406 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:53:02.074406 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:53:02.074406 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:53:02.074406 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:53:02.074406 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:53:02.074406 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:53:02.074406 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:53:02.074406 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:02.080520 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 424/850] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:53:01 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:53:02.080644 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 427/851] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 27 18:53:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:53:02.088682 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b66424-ef04-47bc-af40-e07aad4435b5 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:02.099026 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:02.101342 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32115831-3e36-40d4-9741-d9741dc74bf1 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:02.209410 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b66424-ef04-47bc-af40-e07aad4435b5 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:02.217486 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32115831-3e36-40d4-9741-d9741dc74bf1 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:02.254612 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f6fe1-c106-4aea-9958-4f28dd11a8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:02.255503 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f6fe1-c106-4aea-9958-4f28dd11a8f0 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:02.255941 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f6fe1-c106-4aea-9958-4f28dd11a8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:02.256058 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1b0370-8daa-4f8e-8536-c9fdcd9bb738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:02.256384 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f6fe1-c106-4aea-9958-4f28dd11a8f0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:02.256604 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b0370-8daa-4f8e-8536-c9fdcd9bb738 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:02.256913 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b0370-8daa-4f8e-8536-c9fdcd9bb738 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:02.257227 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b0370-8daa-4f8e-8536-c9fdcd9bb738 None admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:02.257371 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3f6fe1-c106-4aea-9958-4f28dd11a8f0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:02.258559 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1b0370-8daa-4f8e-8536-c9fdcd9bb738 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:02.258902 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3f6fe1-c106-4aea-9958-4f28dd11a8f0 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:02.259093 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1b0370-8daa-4f8e-8536-c9fdcd9bb738 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:02.261721 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1b0370-8daa-4f8e-8536-c9fdcd9bb738 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:02.269243 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-4b3f6fe1-c106-4aea-9958-4f28dd11a8f0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 18:53:02.269243 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:02.269243 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:53:02.269243 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:53:02.269243 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:53:02.269243 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:53:02.269243 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:53:02.269243 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:53:02.269243 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 18:53:02.269243 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:02.269243 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:53:02.269243 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:02.269243 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:02.269243 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:02.269243 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:02.269243 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:02.270243 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:02.270243 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:02.270243 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:02.270243 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:02.270243 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:02.270243 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:02.270243 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:02.270243 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:53:02.270243 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:53:02.270243 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:53:02.270243 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:53:02.270243 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:02.270243 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:02.270243 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:02.270243 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:02.270243 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:02.271251 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:02.271251 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:02.271251 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:02.271251 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:02.271251 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:02.271251 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:02.271251 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:02.271251 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:02.271251 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:02.271251 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:02.271251 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:02.271251 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:53:02.271251 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:53:02.271251 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 18:53:02.271251 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:02.271251 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 428/852] 10.222.0.20 () {56 vars in 1132 bytes} [Wed Jul 27 18:53:02 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:53:02.276970 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 425/853] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 27 18:53:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:02.279550 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f6fe1-c106-4aea-9958-4f28dd11a8f0 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:02.284706 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1b0370-8daa-4f8e-8536-c9fdcd9bb738 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:02.348551 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:02.358929 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:02.399897 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1b0370-8daa-4f8e-8536-c9fdcd9bb738 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:02.411549 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f6fe1-c106-4aea-9958-4f28dd11a8f0 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:02.434999 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8825bc65-5e8b-4d34-8dc5-f1056f193233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:02.435596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825bc65-5e8b-4d34-8dc5-f1056f193233 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:02.435898 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825bc65-5e8b-4d34-8dc5-f1056f193233 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:02.436169 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825bc65-5e8b-4d34-8dc5-f1056f193233 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:02.436950 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8825bc65-5e8b-4d34-8dc5-f1056f193233 None admin] RBAC: Adding query filter params (role.id=0f4a39b061e148418413cfe647af9a34, scope.project.id=31f027c53398443eb548eaf3f24523e0, user.id=16a9f1909ab3458c8c131986e303831a) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:02.437256 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8825bc65-5e8b-4d34-8dc5-f1056f193233 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:02.438661 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8825bc65-5e8b-4d34-8dc5-f1056f193233 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:02.451994 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 426/854] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 27 18:53:02 2022] GET /identity/v3/role_assignments?user.id=16a9f1909ab3458c8c131986e303831a&scope.project.id=31f027c53398443eb548eaf3f24523e0&role.id=0f4a39b061e148418413cfe647af9a34 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:02.456328 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3770b7e6-2262-44e1-80f2-5b611b04be01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:02.457311 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770b7e6-2262-44e1-80f2-5b611b04be01 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:02.457815 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770b7e6-2262-44e1-80f2-5b611b04be01 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:02.458290 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770b7e6-2262-44e1-80f2-5b611b04be01 None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:02.459220 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3770b7e6-2262-44e1-80f2-5b611b04be01 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:02.459766 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3770b7e6-2262-44e1-80f2-5b611b04be01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:02.461454 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3770b7e6-2262-44e1-80f2-5b611b04be01 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:02.472177 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 429/855] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Jul 27 18:53:02 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:02.473920 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8825bc65-5e8b-4d34-8dc5-f1056f193233 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:02.588090 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8825bc65-5e8b-4d34-8dc5-f1056f193233 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:02.607658 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884622f-6ef9-4654-a78a-8add08ba3df8 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:02.607950 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884622f-6ef9-4654-a78a-8add08ba3df8 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:02.609631 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884622f-6ef9-4654-a78a-8add08ba3df8 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:02.612103 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 430/856] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:53:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:53:02.616979 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353db59-6117-446e-bb16-2c81d590ac18 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:02.617256 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353db59-6117-446e-bb16-2c81d590ac18 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:02.617550 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353db59-6117-446e-bb16-2c81d590ac18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:02.627273 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:02.635880 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b8a580-08f0-4860-bd52-00e93ffa8e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:02.636510 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8a580-08f0-4860-bd52-00e93ffa8e13 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:02.636792 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8a580-08f0-4860-bd52-00e93ffa8e13 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:02.637067 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8a580-08f0-4860-bd52-00e93ffa8e13 None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:02.637754 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b8a580-08f0-4860-bd52-00e93ffa8e13 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:02.638058 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b8a580-08f0-4860-bd52-00e93ffa8e13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:02.639420 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b8a580-08f0-4860-bd52-00e93ffa8e13 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:02.647032 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-8353db59-6117-446e-bb16-2c81d590ac18 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:53:02.648231 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 427/857] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Jul 27 18:53:02 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:02.648876 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-8353db59-6117-446e-bb16-2c81d590ac18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:02.742334 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 431/858] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:53:02 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 18:53:02.765382 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b8a580-08f0-4860-bd52-00e93ffa8e13 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:02.873101 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b8a580-08f0-4860-bd52-00e93ffa8e13 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:02.907669 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ccea3-95ee-4b75-bb84-a1cb8e9c2edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:02.908333 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ccea3-95ee-4b75-bb84-a1cb8e9c2edb None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:02.908610 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ccea3-95ee-4b75-bb84-a1cb8e9c2edb None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:02.908886 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ccea3-95ee-4b75-bb84-a1cb8e9c2edb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:02.919347 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ccea3-95ee-4b75-bb84-a1cb8e9c2edb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:53:02.924864 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-e96ccea3-95ee-4b75-bb84-a1cb8e9c2edb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:53:02.924864 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:02.924864 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:02.924864 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:02.924864 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:02.924864 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:02.924864 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:02.924864 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:02.924864 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:02.924864 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:02.924864 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:02.924864 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:02.924864 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:53:02.924864 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:53:02.924864 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:53:02.924864 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:53:02.926992 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:53:02.926992 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:53:02.926992 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:53:02.926992 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:53:02.926992 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:02.926992 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:02.926992 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:02.926992 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:02.926992 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:02.926992 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:02.926992 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:02.926992 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:02.926992 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:02.926992 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:02.926992 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:02.926992 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:02.929620 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:02.929620 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:02.929620 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:02.929620 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:02.929620 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:53:02.929620 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:53:02.929620 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:53:02.929620 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:53:02.929620 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:53:02.929620 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:53:02.929620 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:53:02.929620 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:53:02.929620 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 428/859] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 27 18:53:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:53:02.934917 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8353db59-6117-446e-bb16-2c81d590ac18 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:02.996478 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:03.043349 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8353db59-6117-446e-bb16-2c81d590ac18 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:03.077975 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e71f6-58bb-4952-bc90-af7a9871f42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:03.078825 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e71f6-58bb-4952-bc90-af7a9871f42e None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:03.079271 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e71f6-58bb-4952-bc90-af7a9871f42e None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:03.079709 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e71f6-58bb-4952-bc90-af7a9871f42e None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:03.080557 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180e71f6-58bb-4952-bc90-af7a9871f42e None admin] RBAC: Adding query filter params (name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:03.081001 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180e71f6-58bb-4952-bc90-af7a9871f42e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:03.082477 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180e71f6-58bb-4952-bc90-af7a9871f42e None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:03.091550 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 432/860] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Jul 27 18:53:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:03.097266 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ccea3-95ee-4b75-bb84-a1cb8e9c2edb None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:03.156343 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:03.201570 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ccea3-95ee-4b75-bb84-a1cb8e9c2edb None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:03.237002 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34039873-903d-4755-9a65-3d9119d3a323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:03.237639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34039873-903d-4755-9a65-3d9119d3a323 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:03.237915 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34039873-903d-4755-9a65-3d9119d3a323 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:03.238181 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34039873-903d-4755-9a65-3d9119d3a323 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:03.249034 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34039873-903d-4755-9a65-3d9119d3a323 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:03.250399 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34039873-903d-4755-9a65-3d9119d3a323 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:03.265113 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-34039873-903d-4755-9a65-3d9119d3a323 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:53:03.265113 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:03.265113 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:03.265113 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:03.265113 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:03.265113 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:03.265113 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:03.265113 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:03.265113 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:03.265113 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:03.265113 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:03.265113 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:03.265113 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:53:03.265113 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:53:03.265113 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:53:03.266241 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:53:03.266241 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:03.266241 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:03.266241 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:03.266241 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:03.266241 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:03.266241 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:03.266241 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:03.266241 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:03.266241 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:03.266241 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:03.266241 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:03.266241 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:03.266241 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:03.266241 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:03.266241 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:03.266241 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:03.267355 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:53:03.267355 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:53:03.267355 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:53:03.267355 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:53:03.274201 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 429/861] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:53:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:53:03.279581 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e71f6-58bb-4952-bc90-af7a9871f42e None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:03.298661 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf3f9b-0d13-45cc-9d49-c1b4a1e07396 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:03.299061 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf3f9b-0d13-45cc-9d49-c1b4a1e07396 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:03.299341 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf3f9b-0d13-45cc-9d49-c1b4a1e07396 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:03.300886 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 430/862] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:53:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:53:03.305776 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee230e97-da2e-48a9-81ec-77c67f03ed82 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:03.306057 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee230e97-da2e-48a9-81ec-77c67f03ed82 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:03.306334 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee230e97-da2e-48a9-81ec-77c67f03ed82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:03.329625 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-ee230e97-da2e-48a9-81ec-77c67f03ed82 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:53:03.331234 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-ee230e97-da2e-48a9-81ec-77c67f03ed82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:03.393872 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e71f6-58bb-4952-bc90-af7a9871f42e None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:03.413634 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:03.430082 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 431/863] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:53:03 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:53:03.436279 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f634c11-879a-4590-9169-0af4cbf823f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:03.436890 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f634c11-879a-4590-9169-0af4cbf823f6 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:03.437167 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f634c11-879a-4590-9169-0af4cbf823f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:03.437438 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f634c11-879a-4590-9169-0af4cbf823f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:03.438127 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f634c11-879a-4590-9169-0af4cbf823f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:03.438431 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f634c11-879a-4590-9169-0af4cbf823f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:03.439791 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f634c11-879a-4590-9169-0af4cbf823f6 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:03.450477 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee230e97-da2e-48a9-81ec-77c67f03ed82 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:03.455248 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 433/864] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:53:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:03.463586 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f634c11-879a-4590-9169-0af4cbf823f6 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:03.503498 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:03.583810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f634c11-879a-4590-9169-0af4cbf823f6 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:03.589134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee230e97-da2e-48a9-81ec-77c67f03ed82 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:03.621945 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6858e24d-05ee-4c83-8a39-b5ca60ef6cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:03.622942 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858e24d-05ee-4c83-8a39-b5ca60ef6cac None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:03.623441 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858e24d-05ee-4c83-8a39-b5ca60ef6cac None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:03.624084 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858e24d-05ee-4c83-8a39-b5ca60ef6cac None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:03.632667 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6858e24d-05ee-4c83-8a39-b5ca60ef6cac None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:03.633825 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de0563-d2e3-4548-95d4-6c0be401b1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:03.634448 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de0563-d2e3-4548-95d4-6c0be401b1fe None admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:03.634724 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de0563-d2e3-4548-95d4-6c0be401b1fe None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:03.634995 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de0563-d2e3-4548-95d4-6c0be401b1fe None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:03.635273 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6858e24d-05ee-4c83-8a39-b5ca60ef6cac None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:03.635703 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31de0563-d2e3-4548-95d4-6c0be401b1fe None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:03.637237 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31de0563-d2e3-4548-95d4-6c0be401b1fe None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:03.650384 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-6858e24d-05ee-4c83-8a39-b5ca60ef6cac None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 18:53:03.650384 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:03.650384 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:03.650384 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:03.650384 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:03.650384 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:03.650384 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:03.650384 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:03.650384 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:03.650384 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:03.650384 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:03.650384 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:03.650384 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:53:03.650384 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:53:03.650384 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:53:03.650384 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:53:03.651435 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:03.651435 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:03.651435 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:53:03.651435 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:53:03.651435 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:53:03.651435 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:53:03.651435 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:03.651435 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:03.651435 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:03.651435 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:03.651435 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:03.651435 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:03.651435 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:03.651435 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:03.651435 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:03.651435 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:03.651435 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:03.651435 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:03.652485 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:03.652485 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:03.652485 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:53:03.652485 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:53:03.652485 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:53:03.652485 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:53:03.652485 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:53:03.652485 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:53:03.652485 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 18:53:03.652485 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:03.661298 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 432/865] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Jul 27 18:53:03 2022] POST /identity/v3/services => generated 251 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:53:03.661459 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 434/866] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Jul 27 18:53:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:53:03.662962 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de0563-d2e3-4548-95d4-6c0be401b1fe None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:03.771563 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:03.782567 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de0563-d2e3-4548-95d4-6c0be401b1fe None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:03.821223 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5a2a6-e5c5-4a88-87b0-6bf25ac809c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:03.821843 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5a2a6-e5c5-4a88-87b0-6bf25ac809c0 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:03.822116 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5a2a6-e5c5-4a88-87b0-6bf25ac809c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:03.822383 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5a2a6-e5c5-4a88-87b0-6bf25ac809c0 None admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:03.823175 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f5a2a6-e5c5-4a88-87b0-6bf25ac809c0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:03.823476 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f5a2a6-e5c5-4a88-87b0-6bf25ac809c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:03.824955 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f5a2a6-e5c5-4a88-87b0-6bf25ac809c0 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:03.845659 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 433/867] 10.222.0.20 () {56 vars in 1149 bytes} [Wed Jul 27 18:53:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:03.851294 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6858e24d-05ee-4c83-8a39-b5ca60ef6cac None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:03.890181 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:03.963066 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6858e24d-05ee-4c83-8a39-b5ca60ef6cac None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:03.998010 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b554e-9d1b-4c14-9780-a2d095de8cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:03.998628 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b554e-9d1b-4c14-9780-a2d095de8cd9 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:03.998906 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b554e-9d1b-4c14-9780-a2d095de8cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:03.999176 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b554e-9d1b-4c14-9780-a2d095de8cd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:04.068714 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b554e-9d1b-4c14-9780-a2d095de8cd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:04.070592 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b554e-9d1b-4c14-9780-a2d095de8cd9 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:04.106052 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:04.175482 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 435/868] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 27 18:53:03 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 27 18:53:04.181164 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5a2a6-e5c5-4a88-87b0-6bf25ac809c0 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:04.291953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5a2a6-e5c5-4a88-87b0-6bf25ac809c0 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:04.334076 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0fcdf-1037-4d7a-8372-73966e580689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:04.335111 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0fcdf-1037-4d7a-8372-73966e580689 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:04.335615 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0fcdf-1037-4d7a-8372-73966e580689 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:04.336168 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0fcdf-1037-4d7a-8372-73966e580689 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:04.346842 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d0fcdf-1037-4d7a-8372-73966e580689 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:04.348569 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d0fcdf-1037-4d7a-8372-73966e580689 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:04.364452 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-32d0fcdf-1037-4d7a-8372-73966e580689 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:53:04.364452 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:04.364452 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:04.364452 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:04.364452 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:04.364452 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:04.364452 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:04.364452 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:04.364452 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:04.364452 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:04.364452 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:04.364452 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:04.364452 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:53:04.364452 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:53:04.364452 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:53:04.365395 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:53:04.365395 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:04.365395 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:04.365395 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:04.365395 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:04.365395 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:04.365395 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:04.365395 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:04.365395 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:04.365395 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:04.365395 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:04.365395 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:04.365395 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:04.365395 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:04.365395 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:04.365395 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:04.365395 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:04.366821 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:53:04.366821 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:53:04.366821 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:53:04.366821 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:53:04.369044 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 434/869] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:53:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:53:04.376218 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b554e-9d1b-4c14-9780-a2d095de8cd9 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:04.477749 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b554e-9d1b-4c14-9780-a2d095de8cd9 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:04.514085 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca4750-ba6b-4026-b4d5-a0e9e2542a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:04.514701 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca4750-ba6b-4026-b4d5-a0e9e2542a8e None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:04.514980 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca4750-ba6b-4026-b4d5-a0e9e2542a8e None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:04.515250 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca4750-ba6b-4026-b4d5-a0e9e2542a8e None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:04.515961 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca4750-ba6b-4026-b4d5-a0e9e2542a8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:04.516282 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca4750-ba6b-4026-b4d5-a0e9e2542a8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:04.517605 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca4750-ba6b-4026-b4d5-a0e9e2542a8e None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:04.521182 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:04.531653 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 436/870] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:53:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:04.540744 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0fcdf-1037-4d7a-8372-73966e580689 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:04.545811 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:04.579867 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a088d-21dc-45bf-8282-7f1a5f8817b8 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:04.580181 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a088d-21dc-45bf-8282-7f1a5f8817b8 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:04.580576 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a088d-21dc-45bf-8282-7f1a5f8817b8 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:04.582162 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 437/871] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:53:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:53:04.589327 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca0eb7-dded-4522-af3b-c1230e73b541 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:04.589661 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca0eb7-dded-4522-af3b-c1230e73b541 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:04.590034 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca0eb7-dded-4522-af3b-c1230e73b541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:04.609487 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-e7ca0eb7-dded-4522-af3b-c1230e73b541 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:53:04.611070 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-e7ca0eb7-dded-4522-af3b-c1230e73b541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:04.650420 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0fcdf-1037-4d7a-8372-73966e580689 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:04.688101 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 438/872] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:53:04 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 18:53:04.699240 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49172666-bea7-47be-a4fb-2a3bdae8e87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:04.699914 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49172666-bea7-47be-a4fb-2a3bdae8e87c None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:04.700200 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49172666-bea7-47be-a4fb-2a3bdae8e87c None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:04.700477 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49172666-bea7-47be-a4fb-2a3bdae8e87c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:04.704954 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ca0eb7-dded-4522-af3b-c1230e73b541 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:04.707614 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49172666-bea7-47be-a4fb-2a3bdae8e87c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:04.709096 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49172666-bea7-47be-a4fb-2a3bdae8e87c None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:04.720950 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-49172666-bea7-47be-a4fb-2a3bdae8e87c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:53:04.720950 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:04.720950 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:04.720950 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:04.720950 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:04.720950 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:04.720950 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:04.720950 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:04.720950 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:04.720950 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:04.720950 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:04.720950 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:04.720950 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:53:04.720950 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:53:04.720950 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:53:04.721844 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:53:04.721844 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:04.721844 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:04.721844 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:04.721844 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:04.721844 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:04.721844 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:04.721844 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:04.721844 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:04.721844 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:04.721844 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:04.721844 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:04.721844 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:04.721844 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:04.721844 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:04.721844 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:04.721844 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:04.722741 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:53:04.722741 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:53:04.722741 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:53:04.722741 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:53:04.722741 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:53:04.722741 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:53:04.722741 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:53:04.722741 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:53:04.722741 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 435/873] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 27 18:53:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:53:04.729884 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49172666-bea7-47be-a4fb-2a3bdae8e87c None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:04.798382 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:04.827878 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ca0eb7-dded-4522-af3b-c1230e73b541 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:04.839112 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49172666-bea7-47be-a4fb-2a3bdae8e87c None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:04.855851 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:04.870736 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb9264-3302-493a-b7c9-05eb20fd3b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:04.870736 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb9264-3302-493a-b7c9-05eb20fd3b2d None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:04.870736 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb9264-3302-493a-b7c9-05eb20fd3b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:04.870736 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb9264-3302-493a-b7c9-05eb20fd3b2d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:04.871174 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acb9264-3302-493a-b7c9-05eb20fd3b2d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:04.871174 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acb9264-3302-493a-b7c9-05eb20fd3b2d None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:04.875823 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3175c60e-b393-43cd-9489-3b03c2b103e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:04.876440 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175c60e-b393-43cd-9489-3b03c2b103e1 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:04.876785 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175c60e-b393-43cd-9489-3b03c2b103e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:04.877052 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175c60e-b393-43cd-9489-3b03c2b103e1 None admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:04.877720 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3175c60e-b393-43cd-9489-3b03c2b103e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:04.878026 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3175c60e-b393-43cd-9489-3b03c2b103e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:04.879431 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3175c60e-b393-43cd-9489-3b03c2b103e1 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:04.882366 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-2acb9264-3302-493a-b7c9-05eb20fd3b2d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 18:53:04.882366 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:04.882366 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:53:04.882366 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:53:04.882366 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:53:04.882366 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:53:04.882366 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:53:04.882366 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:53:04.882366 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 18:53:04.882366 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:04.882366 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:53:04.882366 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:04.882366 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:04.882366 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:04.882366 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:04.882366 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:04.882366 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:04.884624 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:04.884624 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:04.884624 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:04.884624 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:04.884624 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:04.884624 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:04.884624 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:53:04.884624 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:53:04.884624 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:53:04.884624 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:53:04.884624 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:04.884624 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:04.884624 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:04.884624 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:04.884624 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:04.884624 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:04.886646 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:04.886646 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:04.886646 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:04.886646 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:04.886646 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:04.886646 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:04.886646 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:04.886646 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:04.886646 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:04.886646 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:04.886646 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:53:04.886646 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:53:04.886646 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 18:53:04.886646 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:04.888934 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 439/874] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Jul 27 18:53:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:53:04.889941 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40282409-2918-4140-bf9f-aa7e0676be1a None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:04.890218 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40282409-2918-4140-bf9f-aa7e0676be1a None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:04.890486 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40282409-2918-4140-bf9f-aa7e0676be1a None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:04.891757 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 440/875] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:53:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:53:04.895877 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40282409-2918-4140-bf9f-aa7e0676be1a None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:04.897916 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 436/876] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 27 18:53:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:04.899461 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a428747-87a8-4dd9-ab57-77ce252b65cd None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:04.899912 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a428747-87a8-4dd9-ab57-77ce252b65cd None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:04.900319 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a428747-87a8-4dd9-ab57-77ce252b65cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:04.921235 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-0a428747-87a8-4dd9-ab57-77ce252b65cd None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:53:04.922432 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-0a428747-87a8-4dd9-ab57-77ce252b65cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:05.003714 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 437/877] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:53:04 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:53:05.003714 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a428747-87a8-4dd9-ab57-77ce252b65cd None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:05.005598 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40282409-2918-4140-bf9f-aa7e0676be1a None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:05.040401 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e65b5-d9c0-4c49-90d9-5cc90c6e260b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:05.041010 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e65b5-d9c0-4c49-90d9-5cc90c6e260b None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:05.041289 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e65b5-d9c0-4c49-90d9-5cc90c6e260b None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:05.041559 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e65b5-d9c0-4c49-90d9-5cc90c6e260b None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:05.042228 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684e65b5-d9c0-4c49-90d9-5cc90c6e260b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:05.042531 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684e65b5-d9c0-4c49-90d9-5cc90c6e260b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:05.043909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684e65b5-d9c0-4c49-90d9-5cc90c6e260b None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:05.048600 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 441/878] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Jul 27 18:53:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:05.049333 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e65b5-d9c0-4c49-90d9-5cc90c6e260b None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:05.065266 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:05.102889 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:05.113165 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a428747-87a8-4dd9-ab57-77ce252b65cd None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:05.153472 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504eda7f-3bf7-42a6-9cc3-210a180f23dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:05.154084 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504eda7f-3bf7-42a6-9cc3-210a180f23dd None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:05.154194 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e65b5-d9c0-4c49-90d9-5cc90c6e260b None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:05.154361 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504eda7f-3bf7-42a6-9cc3-210a180f23dd None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:05.154631 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504eda7f-3bf7-42a6-9cc3-210a180f23dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:05.155412 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504eda7f-3bf7-42a6-9cc3-210a180f23dd None admin] RBAC: Adding query filter params (role.id=306da3282d854292a7a53b8642ee373b, scope.project.id=31f027c53398443eb548eaf3f24523e0, user.id=a277ddae777442869114c4c5deff7d7e) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:05.155737 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504eda7f-3bf7-42a6-9cc3-210a180f23dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:05.157181 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504eda7f-3bf7-42a6-9cc3-210a180f23dd None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:05.162971 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 438/879] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 27 18:53:04 2022] GET /identity/v3/role_assignments?user.id=a277ddae777442869114c4c5deff7d7e&scope.project.id=31f027c53398443eb548eaf3f24523e0&role.id=306da3282d854292a7a53b8642ee373b => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:05.163588 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504eda7f-3bf7-42a6-9cc3-210a180f23dd None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:05.200978 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02219b48-5c0e-46f8-9761-6d8d89f214c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:05.201610 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02219b48-5c0e-46f8-9761-6d8d89f214c5 None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:05.201888 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02219b48-5c0e-46f8-9761-6d8d89f214c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:05.202160 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02219b48-5c0e-46f8-9761-6d8d89f214c5 None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:05.202863 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02219b48-5c0e-46f8-9761-6d8d89f214c5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:05.204273 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02219b48-5c0e-46f8-9761-6d8d89f214c5 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:05.230282 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 442/880] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Jul 27 18:53:05 2022] POST /identity/v3/services => generated 269 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:53:05.307490 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504eda7f-3bf7-42a6-9cc3-210a180f23dd None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:05.328486 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:05.353363 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c2a80-90b2-4077-86d6-6fcfb317961b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:05.353983 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c2a80-90b2-4077-86d6-6fcfb317961b None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:05.354257 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c2a80-90b2-4077-86d6-6fcfb317961b None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:05.354522 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c2a80-90b2-4077-86d6-6fcfb317961b None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:05.355204 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729c2a80-90b2-4077-86d6-6fcfb317961b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:05.355506 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729c2a80-90b2-4077-86d6-6fcfb317961b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:05.356927 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729c2a80-90b2-4077-86d6-6fcfb317961b None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:05.362739 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 439/881] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Jul 27 18:53:05 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:05.837589 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9872205-5da7-43c4-9457-19faa33cd8c1 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:05.837784 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9872205-5da7-43c4-9457-19faa33cd8c1 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:05.838059 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9872205-5da7-43c4-9457-19faa33cd8c1 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:05.839671 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 443/882] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:53:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:53:05.844867 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1adbe7c-048c-48cb-aac1-a7745f3074d1 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:05.845308 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1adbe7c-048c-48cb-aac1-a7745f3074d1 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:05.845404 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1adbe7c-048c-48cb-aac1-a7745f3074d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:05.863554 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-c1adbe7c-048c-48cb-aac1-a7745f3074d1 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:53:05.864760 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-c1adbe7c-048c-48cb-aac1-a7745f3074d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:05.934115 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 440/883] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:53:05 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:53:05.956246 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9872205-5da7-43c4-9457-19faa33cd8c1 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:06.069114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9872205-5da7-43c4-9457-19faa33cd8c1 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:06.082560 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:06.104915 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041227ad-749f-48a1-9e28-6ae468e42f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:06.105878 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041227ad-749f-48a1-9e28-6ae468e42f48 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:06.106363 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041227ad-749f-48a1-9e28-6ae468e42f48 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:06.106850 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041227ad-749f-48a1-9e28-6ae468e42f48 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:06.107713 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041227ad-749f-48a1-9e28-6ae468e42f48 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:06.109266 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041227ad-749f-48a1-9e28-6ae468e42f48 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:06.119208 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-041227ad-749f-48a1-9e28-6ae468e42f48 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 18:53:06.119208 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:06.119208 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:53:06.119208 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:53:06.119208 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:53:06.119208 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:53:06.119208 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:53:06.119208 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:53:06.119208 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 18:53:06.119208 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:06.119208 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:53:06.119208 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:06.119208 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:06.119208 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:06.119208 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:06.119208 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:06.119208 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:06.120204 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:06.120204 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:06.120204 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:06.120204 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:06.120204 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:06.120204 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:06.120204 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:53:06.120204 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:53:06.120204 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:53:06.120204 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:53:06.120204 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:06.120204 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:06.120204 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:06.120204 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:06.120204 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:06.120204 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:06.121036 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:06.121036 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:06.121036 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:06.121036 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:06.121036 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:06.121036 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:06.121036 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:06.121036 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:06.121036 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:06.121036 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:06.121036 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:53:06.121036 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:53:06.121036 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 18:53:06.121036 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:06.123851 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 444/884] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 27 18:53:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:53:06.133538 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1adbe7c-048c-48cb-aac1-a7745f3074d1 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:06.234163 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1adbe7c-048c-48cb-aac1-a7745f3074d1 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:06.244659 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:06.270200 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd6bb10-6e65-457b-8dfd-41dd343e9a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:06.270818 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd6bb10-6e65-457b-8dfd-41dd343e9a8a None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:06.271098 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd6bb10-6e65-457b-8dfd-41dd343e9a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:06.271373 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd6bb10-6e65-457b-8dfd-41dd343e9a8a None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:06.272083 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd6bb10-6e65-457b-8dfd-41dd343e9a8a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:06.272458 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd6bb10-6e65-457b-8dfd-41dd343e9a8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:06.273826 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd6bb10-6e65-457b-8dfd-41dd343e9a8a None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:06.278878 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 441/885] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 27 18:53:06 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:06.284467 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041227ad-749f-48a1-9e28-6ae468e42f48 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:06.390058 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041227ad-749f-48a1-9e28-6ae468e42f48 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:06.426774 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e434d83c-50d0-44f8-b8bd-486be67f5ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:06.427397 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434d83c-50d0-44f8-b8bd-486be67f5ec4 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:06.427695 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434d83c-50d0-44f8-b8bd-486be67f5ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:06.427975 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434d83c-50d0-44f8-b8bd-486be67f5ec4 None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:06.428687 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e434d83c-50d0-44f8-b8bd-486be67f5ec4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:06.428991 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e434d83c-50d0-44f8-b8bd-486be67f5ec4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:06.430416 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e434d83c-50d0-44f8-b8bd-486be67f5ec4 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:06.436014 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 445/886] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 27 18:53:06 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:06.442123 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd6bb10-6e65-457b-8dfd-41dd343e9a8a None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:06.550502 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd6bb10-6e65-457b-8dfd-41dd343e9a8a None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:06.589749 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1497df8-085d-45be-b41c-e17fc4b394d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:06.590368 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1497df8-085d-45be-b41c-e17fc4b394d5 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:06.590642 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1497df8-085d-45be-b41c-e17fc4b394d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:06.590956 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1497df8-085d-45be-b41c-e17fc4b394d5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:06.591730 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1497df8-085d-45be-b41c-e17fc4b394d5 None admin] RBAC: Adding query filter params (interface=public, service_id=7d5c962963fe4881b98d49c7a44d7f47, region_id=RegionOne) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:06.592041 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1497df8-085d-45be-b41c-e17fc4b394d5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:06.593389 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1497df8-085d-45be-b41c-e17fc4b394d5 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:06.599101 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 442/887] 10.222.0.20 () {56 vars in 1251 bytes} [Wed Jul 27 18:53:06 2022] GET /identity/v3/endpoints?service_id=7d5c962963fe4881b98d49c7a44d7f47&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:06.604412 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e434d83c-50d0-44f8-b8bd-486be67f5ec4 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:06.656202 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:06.705178 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e434d83c-50d0-44f8-b8bd-486be67f5ec4 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:06.740953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7608bc-f2d4-4ef6-b2e1-84b2632faebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:06.742084 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7608bc-f2d4-4ef6-b2e1-84b2632faebf None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:06.742368 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7608bc-f2d4-4ef6-b2e1-84b2632faebf None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:06.742643 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7608bc-f2d4-4ef6-b2e1-84b2632faebf None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:06.743290 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7608bc-f2d4-4ef6-b2e1-84b2632faebf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:06.744679 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7608bc-f2d4-4ef6-b2e1-84b2632faebf None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:06.750625 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 446/888] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Jul 27 18:53:06 2022] GET /identity/v3/services => generated 1268 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:53:07.312933 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec1a67-09f8-4f9f-a326-1bd8eb6e484f None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:07.313459 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec1a67-09f8-4f9f-a326-1bd8eb6e484f None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:07.313459 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec1a67-09f8-4f9f-a326-1bd8eb6e484f None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:07.315117 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 443/889] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:53:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:53:07.320378 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a126ee7-1883-4b57-9543-d0324d352aeb None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:07.320781 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a126ee7-1883-4b57-9543-d0324d352aeb None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:07.320965 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a126ee7-1883-4b57-9543-d0324d352aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:07.339648 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-1a126ee7-1883-4b57-9543-d0324d352aeb None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:53:07.340861 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-1a126ee7-1883-4b57-9543-d0324d352aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:07.385952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e0f95-4a4b-45ea-af2e-61968ccff589 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:07.386571 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e0f95-4a4b-45ea-af2e-61968ccff589 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:07.387049 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e0f95-4a4b-45ea-af2e-61968ccff589 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:07.388873 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 444/890] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:53:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:53:07.393939 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec627c0-b148-4a73-8411-8c53a8b1afa9 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:07.394460 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec627c0-b148-4a73-8411-8c53a8b1afa9 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:07.394953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec627c0-b148-4a73-8411-8c53a8b1afa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:07.414683 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-fec627c0-b148-4a73-8411-8c53a8b1afa9 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:53:07.415489 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 447/891] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:53:07 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:53:07.416477 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-fec627c0-b148-4a73-8411-8c53a8b1afa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:07.437986 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a126ee7-1883-4b57-9543-d0324d352aeb None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:07.449166 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:07.485693 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:07.495805 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 445/892] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:53:07 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 18:53:07.497471 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896e7c8-8ddd-417a-bd1f-cee99f063861 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:07.498006 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896e7c8-8ddd-417a-bd1f-cee99f063861 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:07.498528 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896e7c8-8ddd-417a-bd1f-cee99f063861 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:07.500261 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 446/893] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:53:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:53:07.504823 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f21b17-db12-47dc-9b75-35447d44d128 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:07.505368 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f21b17-db12-47dc-9b75-35447d44d128 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:07.505860 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f21b17-db12-47dc-9b75-35447d44d128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:07.529946 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-43f21b17-db12-47dc-9b75-35447d44d128 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:53:07.529946 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-43f21b17-db12-47dc-9b75-35447d44d128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:07.561329 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a126ee7-1883-4b57-9543-d0324d352aeb None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:07.596171 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4240b59d-d4ec-40d8-86a9-79c0f9dd259a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:07.596737 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4240b59d-d4ec-40d8-86a9-79c0f9dd259a None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:07.597016 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4240b59d-d4ec-40d8-86a9-79c0f9dd259a None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:07.597286 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4240b59d-d4ec-40d8-86a9-79c0f9dd259a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:07.597900 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4240b59d-d4ec-40d8-86a9-79c0f9dd259a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:07.598884 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 447/894] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:53:07 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:53:07.599245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4240b59d-d4ec-40d8-86a9-79c0f9dd259a None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:07.599882 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f21b17-db12-47dc-9b75-35447d44d128 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:07.615874 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-4240b59d-d4ec-40d8-86a9-79c0f9dd259a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 18:53:07.615874 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:07.615874 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:53:07.615874 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:53:07.615874 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:53:07.615874 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:53:07.615874 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:53:07.615874 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:53:07.615874 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 18:53:07.615874 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:07.615874 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:53:07.615874 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:07.615874 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:07.615874 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:07.615874 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:07.615874 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:07.617368 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:07.617368 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:07.617368 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:07.617368 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:07.617368 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:07.617368 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:07.617368 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:07.617368 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:53:07.617368 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:53:07.617368 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:53:07.617368 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:53:07.617368 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:07.617368 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:07.617368 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:07.617368 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:07.617368 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:07.618197 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:07.618197 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:07.618197 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:07.618197 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:07.618197 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:07.618197 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:07.618197 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:07.618197 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:07.618197 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:07.618197 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:07.618197 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:07.618197 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:53:07.618197 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:53:07.618197 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 18:53:07.618197 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:07.625727 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 448/895] 10.222.0.20 () {56 vars in 1132 bytes} [Wed Jul 27 18:53:07 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:53:07.625727 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4240b59d-d4ec-40d8-86a9-79c0f9dd259a None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:07.706809 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:07.715003 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f21b17-db12-47dc-9b75-35447d44d128 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:07.731023 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:07.734571 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4240b59d-d4ec-40d8-86a9-79c0f9dd259a None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:07.752097 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e35ec0f-b2f2-4ec5-ae67-fe1685f710bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:07.752735 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35ec0f-b2f2-4ec5-ae67-fe1685f710bc None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:07.753016 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35ec0f-b2f2-4ec5-ae67-fe1685f710bc None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:07.753290 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35ec0f-b2f2-4ec5-ae67-fe1685f710bc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:07.764302 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e35ec0f-b2f2-4ec5-ae67-fe1685f710bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:53:07.769195 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-3e35ec0f-b2f2-4ec5-ae67-fe1685f710bc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 18:53:07.769195 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:07.769195 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:07.769195 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:07.769195 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:07.769195 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:07.769195 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:07.769195 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:07.769195 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:07.769195 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:07.769195 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:07.769195 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:07.769195 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:53:07.769195 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:53:07.769195 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:53:07.769195 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:53:07.770114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:53:07.770114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:53:07.770114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:53:07.770114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:53:07.770114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:07.770114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:07.770114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:07.770114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:07.770114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:07.770114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:07.770114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:07.770114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:07.770114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:07.770114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:07.770114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:07.770114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:07.770940 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:07.770940 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:07.770940 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:07.770940 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:07.770940 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:53:07.770940 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:53:07.770940 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:53:07.770940 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:53:07.770940 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:53:07.770940 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:53:07.770940 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 18:53:07.770940 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:53:07.770940 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 448/896] 10.222.0.20 () {56 vars in 1120 bytes} [Wed Jul 27 18:53:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:53:07.772970 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e35ec0f-b2f2-4ec5-ae67-fe1685f710bc None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:07.774761 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0c327-2d56-471a-b797-a9f3eacfd9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:07.775375 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0c327-2d56-471a-b797-a9f3eacfd9fd None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:07.775654 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0c327-2d56-471a-b797-a9f3eacfd9fd None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:07.776238 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0c327-2d56-471a-b797-a9f3eacfd9fd None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:07.776934 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba0c327-2d56-471a-b797-a9f3eacfd9fd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:07.778296 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba0c327-2d56-471a-b797-a9f3eacfd9fd None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:07.804060 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 449/897] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Jul 27 18:53:07 2022] POST /identity/v3/services => generated 241 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:53:07.804887 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0c327-2d56-471a-b797-a9f3eacfd9fd None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:07.904522 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e35ec0f-b2f2-4ec5-ae67-fe1685f710bc None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:07.961816 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02014c5b-6411-4033-8b07-d14796d337cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:07.961816 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02014c5b-6411-4033-8b07-d14796d337cf None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:07.961816 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02014c5b-6411-4033-8b07-d14796d337cf None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:07.961816 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02014c5b-6411-4033-8b07-d14796d337cf None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:07.962796 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02014c5b-6411-4033-8b07-d14796d337cf None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:07.962796 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02014c5b-6411-4033-8b07-d14796d337cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:07.962796 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02014c5b-6411-4033-8b07-d14796d337cf None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:07.971242 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 449/898] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Jul 27 18:53:07 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:07.972626 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02014c5b-6411-4033-8b07-d14796d337cf None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:07.981351 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0c327-2d56-471a-b797-a9f3eacfd9fd None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:07.998028 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:08.032305 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f6b7ff-83b3-4d82-9b5c-522b059ac781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:08.032931 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6b7ff-83b3-4d82-9b5c-522b059ac781 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:08.033596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6b7ff-83b3-4d82-9b5c-522b059ac781 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:08.033880 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6b7ff-83b3-4d82-9b5c-522b059ac781 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:08.035035 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f6b7ff-83b3-4d82-9b5c-522b059ac781 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:08.035346 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f6b7ff-83b3-4d82-9b5c-522b059ac781 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:08.036914 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f6b7ff-83b3-4d82-9b5c-522b059ac781 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:08.047848 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 450/899] 10.222.0.20 () {56 vars in 1115 bytes} [Wed Jul 27 18:53:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:08.053313 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f6b7ff-83b3-4d82-9b5c-522b059ac781 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:08.084271 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:08.102182 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02014c5b-6411-4033-8b07-d14796d337cf None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:08.147030 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d9280a-64d7-4f59-b040-499a0a78ed7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:08.148440 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d9280a-64d7-4f59-b040-499a0a78ed7c None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:08.148888 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d9280a-64d7-4f59-b040-499a0a78ed7c None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:08.149873 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d9280a-64d7-4f59-b040-499a0a78ed7c None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:08.150732 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d9280a-64d7-4f59-b040-499a0a78ed7c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:08.151218 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d9280a-64d7-4f59-b040-499a0a78ed7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:08.154310 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d9280a-64d7-4f59-b040-499a0a78ed7c None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:08.163771 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 450/900] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Jul 27 18:53:07 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:53:08.167933 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d9280a-64d7-4f59-b040-499a0a78ed7c None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:08.185935 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f6b7ff-83b3-4d82-9b5c-522b059ac781 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:08.230690 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a476867e-f0b2-4e62-92e8-954f6bd532dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:08.231863 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a476867e-f0b2-4e62-92e8-954f6bd532dd None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:08.232295 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a476867e-f0b2-4e62-92e8-954f6bd532dd None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:08.232854 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a476867e-f0b2-4e62-92e8-954f6bd532dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:08.247032 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a476867e-f0b2-4e62-92e8-954f6bd532dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:08.249468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a476867e-f0b2-4e62-92e8-954f6bd532dd None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:08.267446 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-a476867e-f0b2-4e62-92e8-954f6bd532dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:53:08.267446 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:08.267446 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:08.267446 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:08.267446 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:08.267446 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:08.267446 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:08.267446 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:08.267446 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:08.267446 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:08.267446 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:08.267446 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:08.267446 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:53:08.267446 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:53:08.267446 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:53:08.268535 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:53:08.268535 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:08.268535 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:08.268535 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:08.268535 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:08.268535 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:08.268535 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:08.268535 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:08.268535 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:08.268535 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:08.268535 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:08.268535 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:08.268535 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:08.268535 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:08.268535 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:08.268535 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:08.268535 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:08.269419 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:53:08.269419 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:53:08.269419 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:53:08.269419 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:08.271570 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 451/901] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:53:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:53:08.271973 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:08.280029 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a476867e-f0b2-4e62-92e8-954f6bd532dd None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:08.301707 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d9280a-64d7-4f59-b040-499a0a78ed7c None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:08.355357 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05523821-31ae-4a4f-b2c6-a48faf81a6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:08.356810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05523821-31ae-4a4f-b2c6-a48faf81a6ff None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:08.357357 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05523821-31ae-4a4f-b2c6-a48faf81a6ff None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:08.357872 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05523821-31ae-4a4f-b2c6-a48faf81a6ff None admin] PATH_INFO: `/v3/endpoints` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:08.359117 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05523821-31ae-4a4f-b2c6-a48faf81a6ff None admin] RBAC: Adding query filter params (interface=public, service_id=7fda82a26704470e9e491cc4c74b4081, region_id=RegionOne) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:08.359628 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05523821-31ae-4a4f-b2c6-a48faf81a6ff None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:08.361473 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05523821-31ae-4a4f-b2c6-a48faf81a6ff None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:08.369090 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 451/902] 10.222.0.20 () {56 vars in 1251 bytes} [Wed Jul 27 18:53:08 2022] GET /identity/v3/endpoints?service_id=7fda82a26704470e9e491cc4c74b4081&interface=public®ion_id=RegionOne => generated 194 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:53:08.374453 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05523821-31ae-4a4f-b2c6-a48faf81a6ff None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:08.383046 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:08.412523 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a476867e-f0b2-4e62-92e8-954f6bd532dd None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:08.449627 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3e9e33-8363-4fde-be17-4e7ca4200090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:08.450231 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e9e33-8363-4fde-be17-4e7ca4200090 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:08.450508 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e9e33-8363-4fde-be17-4e7ca4200090 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:08.450777 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e9e33-8363-4fde-be17-4e7ca4200090 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:08.451512 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3e9e33-8363-4fde-be17-4e7ca4200090 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:08.451846 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3e9e33-8363-4fde-be17-4e7ca4200090 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:08.453192 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3e9e33-8363-4fde-be17-4e7ca4200090 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:08.470338 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 452/903] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:53:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:53:08.471907 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3e9e33-8363-4fde-be17-4e7ca4200090 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:08.510206 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05523821-31ae-4a4f-b2c6-a48faf81a6ff None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:08.557542 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53acd2c1-9abb-4349-bae1-cfcc6f3d2697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:08.558432 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53acd2c1-9abb-4349-bae1-cfcc6f3d2697 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:08.558939 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53acd2c1-9abb-4349-bae1-cfcc6f3d2697 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:08.559429 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53acd2c1-9abb-4349-bae1-cfcc6f3d2697 None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:08.560314 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53acd2c1-9abb-4349-bae1-cfcc6f3d2697 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:08.561901 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53acd2c1-9abb-4349-bae1-cfcc6f3d2697 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:08.575859 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 452/904] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Jul 27 18:53:08 2022] GET /identity/v3/services => generated 1497 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:53:08.585830 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3e9e33-8363-4fde-be17-4e7ca4200090 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:08.628529 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87ac9f9-7b93-45fb-b15f-ff022f2784bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:08.629199 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ac9f9-7b93-45fb-b15f-ff022f2784bd None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:08.629476 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ac9f9-7b93-45fb-b15f-ff022f2784bd None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:08.629744 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ac9f9-7b93-45fb-b15f-ff022f2784bd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:08.632549 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:08.639406 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87ac9f9-7b93-45fb-b15f-ff022f2784bd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:08.640931 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87ac9f9-7b93-45fb-b15f-ff022f2784bd None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:08.654959 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-c87ac9f9-7b93-45fb-b15f-ff022f2784bd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 18:53:08.654959 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:08.654959 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:08.654959 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:08.654959 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:08.654959 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:08.654959 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:08.654959 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:08.654959 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:08.654959 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:08.654959 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:08.654959 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:08.654959 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:53:08.654959 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:53:08.654959 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:53:08.654959 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:53:08.656384 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:08.656384 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:08.656384 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:53:08.656384 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:53:08.656384 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:53:08.656384 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:53:08.656384 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:08.656384 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:08.656384 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:08.656384 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:08.656384 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:08.656384 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:08.656384 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:08.656384 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:08.656384 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:08.656384 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:08.656384 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:08.656384 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:08.658651 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:08.658651 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:08.658651 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:53:08.658651 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:53:08.658651 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:53:08.658651 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:53:08.658651 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:53:08.658651 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:53:08.658651 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 18:53:08.658651 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:08.658651 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 453/905] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Jul 27 18:53:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:53:08.665732 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53acd2c1-9abb-4349-bae1-cfcc6f3d2697 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:08.677878 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:08.779199 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53acd2c1-9abb-4349-bae1-cfcc6f3d2697 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:08.814868 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22480905-fd84-4e22-acac-d93b4a32b24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:08.815873 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22480905-fd84-4e22-acac-d93b4a32b24b None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:08.816372 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22480905-fd84-4e22-acac-d93b4a32b24b None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:08.816905 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22480905-fd84-4e22-acac-d93b4a32b24b None admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:08.817908 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22480905-fd84-4e22-acac-d93b4a32b24b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:08.818433 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22480905-fd84-4e22-acac-d93b4a32b24b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:08.820115 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22480905-fd84-4e22-acac-d93b4a32b24b None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:08.843075 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12800ab5-0506-4d73-a2d4-7b45b822b0f4 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:08.843075 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12800ab5-0506-4d73-a2d4-7b45b822b0f4 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:08.843075 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12800ab5-0506-4d73-a2d4-7b45b822b0f4 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:08.843628 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 454/907] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:53:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:53:08.843743 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 453/907] 10.222.0.20 () {56 vars in 1149 bytes} [Wed Jul 27 18:53:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:08.845106 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12800ab5-0506-4d73-a2d4-7b45b822b0f4 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:08.848827 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247720e-3d68-490b-a44e-c10ddbf6fe32 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:08.849118 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247720e-3d68-490b-a44e-c10ddbf6fe32 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:08.849403 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247720e-3d68-490b-a44e-c10ddbf6fe32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:08.869025 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-a247720e-3d68-490b-a44e-c10ddbf6fe32 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:53:08.870277 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-a247720e-3d68-490b-a44e-c10ddbf6fe32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:08.940472 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:08.955786 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 454/908] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:53:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:53:08.965125 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12800ab5-0506-4d73-a2d4-7b45b822b0f4 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:08.972552 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247720e-3d68-490b-a44e-c10ddbf6fe32 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:09.002660 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8f11d-c319-4410-adf2-7dedae0de315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:09.003303 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8f11d-c319-4410-adf2-7dedae0de315 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:09.003586 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8f11d-c319-4410-adf2-7dedae0de315 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:09.003923 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8f11d-c319-4410-adf2-7dedae0de315 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:09.083866 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247720e-3d68-490b-a44e-c10ddbf6fe32 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:09.087014 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:09.096623 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb8f11d-c319-4410-adf2-7dedae0de315 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:09.099001 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb8f11d-c319-4410-adf2-7dedae0de315 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:09.125993 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee1689-3e04-4ea7-92d9-612fb82b3cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:09.127347 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee1689-3e04-4ea7-92d9-612fb82b3cfc None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:09.128043 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee1689-3e04-4ea7-92d9-612fb82b3cfc None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:09.128463 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee1689-3e04-4ea7-92d9-612fb82b3cfc None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:09.129499 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee1689-3e04-4ea7-92d9-612fb82b3cfc None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:09.131883 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee1689-3e04-4ea7-92d9-612fb82b3cfc None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:09.144097 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-b8ee1689-3e04-4ea7-92d9-612fb82b3cfc None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 18:53:09.144097 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:09.144097 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:53:09.144097 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:53:09.144097 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:53:09.144097 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:53:09.144097 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:53:09.144097 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:53:09.144097 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 18:53:09.144097 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:53:09.144097 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:53:09.144097 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:53:09.144097 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:09.144097 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:09.144097 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:09.144097 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:09.144097 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:09.145281 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:09.145281 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:09.145281 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:09.145281 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:09.145281 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:09.145281 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:09.145281 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:53:09.145281 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:53:09.145281 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:53:09.145281 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:53:09.145281 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:09.145281 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:09.145281 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:09.145281 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:09.145281 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:09.145281 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:09.146312 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:09.146312 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:09.146312 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:09.146312 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:09.146312 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:09.146312 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:09.146312 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:09.146312 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:09.146312 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:09.146312 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:09.146312 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:53:09.146312 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:53:09.146312 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 18:53:09.146312 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:53:09.149666 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 455/909] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 27 18:53:08 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:53:09.155183 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee1689-3e04-4ea7-92d9-612fb82b3cfc None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:09.216104 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:09.227499 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 455/910] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 27 18:53:08 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 18:53:09.235866 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8f11d-c319-4410-adf2-7dedae0de315 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:09.269667 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee1689-3e04-4ea7-92d9-612fb82b3cfc None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:09.322275 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712194b1-7289-4778-a2a0-a511a86a9701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:09.322915 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712194b1-7289-4778-a2a0-a511a86a9701 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:09.323193 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712194b1-7289-4778-a2a0-a511a86a9701 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:09.323473 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712194b1-7289-4778-a2a0-a511a86a9701 None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:09.324174 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712194b1-7289-4778-a2a0-a511a86a9701 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:09.324737 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712194b1-7289-4778-a2a0-a511a86a9701 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:09.325924 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712194b1-7289-4778-a2a0-a511a86a9701 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:09.331552 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 456/911] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 27 18:53:09 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:53:09.337955 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712194b1-7289-4778-a2a0-a511a86a9701 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:09.341849 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:09.349693 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8f11d-c319-4410-adf2-7dedae0de315 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:09.388236 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07425b4a-fb8f-4ce3-aab2-8f72118afc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:09.389590 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07425b4a-fb8f-4ce3-aab2-8f72118afc80 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:09.390020 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07425b4a-fb8f-4ce3-aab2-8f72118afc80 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:09.390440 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07425b4a-fb8f-4ce3-aab2-8f72118afc80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:09.401266 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07425b4a-fb8f-4ce3-aab2-8f72118afc80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:09.402701 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07425b4a-fb8f-4ce3-aab2-8f72118afc80 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:09.420283 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-07425b4a-fb8f-4ce3-aab2-8f72118afc80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:53:09.420283 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:09.420283 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:09.420283 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:09.420283 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:09.420283 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:09.420283 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:09.420283 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:09.420283 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:09.420283 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:09.420283 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:09.420283 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:09.420283 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:53:09.420283 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:53:09.420283 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:53:09.421270 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:53:09.421270 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:09.421270 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:09.421270 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:09.421270 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:09.421270 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:09.421270 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:09.421270 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:09.421270 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:09.421270 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:09.421270 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:09.421270 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:09.421270 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:09.421270 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:09.421270 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:09.421270 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:09.421270 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:09.422162 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:53:09.422162 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:53:09.422162 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:53:09.422162 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:09.424669 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 456/912] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:53:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:53:09.430203 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07425b4a-fb8f-4ce3-aab2-8f72118afc80 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:09.471387 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712194b1-7289-4778-a2a0-a511a86a9701 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:09.501237 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:09.514979 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172b5c70-e8ff-4eb9-b536-37910d67869f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:09.515594 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b5c70-e8ff-4eb9-b536-37910d67869f None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:09.515907 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b5c70-e8ff-4eb9-b536-37910d67869f None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:09.516181 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b5c70-e8ff-4eb9-b536-37910d67869f None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:09.517391 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172b5c70-e8ff-4eb9-b536-37910d67869f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:09.517702 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172b5c70-e8ff-4eb9-b536-37910d67869f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:09.520709 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172b5c70-e8ff-4eb9-b536-37910d67869f None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:09.535729 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 457/913] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 27 18:53:09 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:53:09.538853 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172b5c70-e8ff-4eb9-b536-37910d67869f None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:09.563593 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07425b4a-fb8f-4ce3-aab2-8f72118afc80 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:09.609050 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911a9da2-5f2a-4ecd-8153-27a49b700a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:09.610470 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a9da2-5f2a-4ecd-8153-27a49b700a3d None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:09.610953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a9da2-5f2a-4ecd-8153-27a49b700a3d None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:09.611576 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a9da2-5f2a-4ecd-8153-27a49b700a3d None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:09.612820 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911a9da2-5f2a-4ecd-8153-27a49b700a3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:09.613552 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911a9da2-5f2a-4ecd-8153-27a49b700a3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:09.616806 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911a9da2-5f2a-4ecd-8153-27a49b700a3d None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:09.637810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 457/914] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:53:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:53:09.639505 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911a9da2-5f2a-4ecd-8153-27a49b700a3d None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:09.650975 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:09.661151 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172b5c70-e8ff-4eb9-b536-37910d67869f None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:09.708472 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e4e78-1e72-40aa-8688-06157625c585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:09.709501 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e4e78-1e72-40aa-8688-06157625c585 None admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:09.710463 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e4e78-1e72-40aa-8688-06157625c585 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:09.710880 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e4e78-1e72-40aa-8688-06157625c585 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:09.712016 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6e4e78-1e72-40aa-8688-06157625c585 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:09.714515 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6e4e78-1e72-40aa-8688-06157625c585 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:09.752419 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 458/915] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Jul 27 18:53:09 2022] POST /identity/v3/endpoints => generated 346 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:53:09.764041 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911a9da2-5f2a-4ecd-8153-27a49b700a3d None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:09.812313 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c4526-d89d-4e9b-9a02-49d57c063bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:09.813458 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c4526-d89d-4e9b-9a02-49d57c063bba None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:09.813958 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c4526-d89d-4e9b-9a02-49d57c063bba None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:09.814454 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c4526-d89d-4e9b-9a02-49d57c063bba None admin] PATH_INFO: `/v3/projects/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:09.823784 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44c4526-d89d-4e9b-9a02-49d57c063bba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:09.825702 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44c4526-d89d-4e9b-9a02-49d57c063bba None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:09.839111 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-c44c4526-d89d-4e9b-9a02-49d57c063bba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:53:09.839111 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:09.839111 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:09.839111 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:09.839111 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:09.839111 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:09.839111 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:09.839111 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:09.839111 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:09.839111 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:09.839111 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:09.839111 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:09.839111 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:53:09.839111 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:53:09.839111 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:53:09.840217 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:53:09.840217 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:09.840217 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:09.840217 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:09.840217 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:09.840217 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:09.840217 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:09.840217 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:09.840217 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:09.840217 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:09.840217 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:09.840217 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:09.840217 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:09.840217 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:09.840217 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:09.840217 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:09.840217 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:09.841177 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:53:09.841177 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:53:09.841177 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:53:09.841177 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:53:09.841177 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:53:09.841177 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:53:09.841177 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:53:09.841177 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:09.847979 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 458/916] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 27 18:53:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:53:09.850362 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e4e78-1e72-40aa-8688-06157625c585 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:09.904260 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:09.939238 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006e7a8-b4a9-4fac-9db2-2caff439e443 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:09.939580 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006e7a8-b4a9-4fac-9db2-2caff439e443 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:09.939955 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006e7a8-b4a9-4fac-9db2-2caff439e443 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:09.941404 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 459/917] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:53:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:53:09.949982 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837a6b8-d5ca-4bf0-89b9-06d3d6243b5e None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:09.949982 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837a6b8-d5ca-4bf0-89b9-06d3d6243b5e None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:09.949982 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837a6b8-d5ca-4bf0-89b9-06d3d6243b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:09.970186 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-3837a6b8-d5ca-4bf0-89b9-06d3d6243b5e None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:53:09.973480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e4e78-1e72-40aa-8688-06157625c585 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:09.973622 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-3837a6b8-d5ca-4bf0-89b9-06d3d6243b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:10.014986 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d9aad-9995-42bd-b647-32dbb25b973a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:10.015613 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d9aad-9995-42bd-b647-32dbb25b973a None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:10.015986 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d9aad-9995-42bd-b647-32dbb25b973a None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:10.016269 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d9aad-9995-42bd-b647-32dbb25b973a None admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:10.017028 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d9aad-9995-42bd-b647-32dbb25b973a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:10.017337 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d9aad-9995-42bd-b647-32dbb25b973a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:10.018776 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d9aad-9995-42bd-b647-32dbb25b973a None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:10.035368 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 459/918] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 27 18:53:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:10.042982 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:10.044558 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d9aad-9995-42bd-b647-32dbb25b973a None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:10.055947 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 460/919] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:53:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 18:53:10.079658 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3837a6b8-d5ca-4bf0-89b9-06d3d6243b5e None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:10.188893 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d9aad-9995-42bd-b647-32dbb25b973a None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:10.192644 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:10.194444 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3837a6b8-d5ca-4bf0-89b9-06d3d6243b5e None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:10.236435 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93edf28-f4ac-4ec1-b80c-8889da05eeca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:10.237082 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93edf28-f4ac-4ec1-b80c-8889da05eeca None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:10.237360 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93edf28-f4ac-4ec1-b80c-8889da05eeca None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:10.237635 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93edf28-f4ac-4ec1-b80c-8889da05eeca None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:10.238263 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93edf28-f4ac-4ec1-b80c-8889da05eeca None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:10.239560 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a3c8fc-99d1-4bd9-85b0-a0e96c01ab3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:10.239910 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93edf28-f4ac-4ec1-b80c-8889da05eeca None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:10.241357 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3c8fc-99d1-4bd9-85b0-a0e96c01ab3c None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:10.241852 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3c8fc-99d1-4bd9-85b0-a0e96c01ab3c None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:10.242625 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3c8fc-99d1-4bd9-85b0-a0e96c01ab3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:10.244079 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a3c8fc-99d1-4bd9-85b0-a0e96c01ab3c None admin] RBAC: Adding query filter params (role.id=f388f0bd9c714f86a7657d98f844d701, scope.project.id=31f027c53398443eb548eaf3f24523e0, user.id=a277ddae777442869114c4c5deff7d7e) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:10.244859 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a3c8fc-99d1-4bd9-85b0-a0e96c01ab3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:10.246456 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a3c8fc-99d1-4bd9-85b0-a0e96c01ab3c None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:10.250138 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-d93edf28-f4ac-4ec1-b80c-8889da05eeca None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 18:53:10.250138 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:10.250138 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:53:10.250138 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:53:10.250138 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:53:10.250138 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:53:10.250138 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:53:10.250138 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:53:10.250138 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 18:53:10.250138 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:10.250138 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:53:10.250138 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:10.250138 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:10.250138 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:10.250138 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:10.250138 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:10.250138 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:10.251190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:10.251190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:10.251190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:10.251190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:10.251190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:10.251190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:10.251190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:53:10.251190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:53:10.251190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:53:10.251190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:53:10.251190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:10.251190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:10.251190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:10.251190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:10.251190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:10.251190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:10.252181 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:10.252181 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:10.252181 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:10.252181 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:10.252181 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:10.252181 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:10.252181 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:10.252181 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:10.252181 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:10.252181 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:10.252181 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:53:10.252181 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:53:10.252181 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 18:53:10.252181 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:10.256321 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 460/921] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 27 18:53:10 2022] GET /identity/v3/role_assignments?user.id=a277ddae777442869114c4c5deff7d7e&scope.project.id=31f027c53398443eb548eaf3f24523e0&role.id=f388f0bd9c714f86a7657d98f844d701 => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:10.257214 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 461/921] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Jul 27 18:53:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:53:10.261430 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a3c8fc-99d1-4bd9-85b0-a0e96c01ab3c None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:10.382542 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a3c8fc-99d1-4bd9-85b0-a0e96c01ab3c None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:10.422271 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f12fd-cda9-4518-8d7e-5a56613959c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:10.423216 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f12fd-cda9-4518-8d7e-5a56613959c9 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:10.423706 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f12fd-cda9-4518-8d7e-5a56613959c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:10.424177 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f12fd-cda9-4518-8d7e-5a56613959c9 None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:10.425051 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787f12fd-cda9-4518-8d7e-5a56613959c9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:10.425556 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787f12fd-cda9-4518-8d7e-5a56613959c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:10.427200 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787f12fd-cda9-4518-8d7e-5a56613959c9 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:10.433294 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 461/922] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Jul 27 18:53:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:53:10.439168 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93edf28-f4ac-4ec1-b80c-8889da05eeca None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:10.500564 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:10.547930 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93edf28-f4ac-4ec1-b80c-8889da05eeca None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:10.583572 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51a16b-fff5-4b16-9821-35efd624bd5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:10.584218 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51a16b-fff5-4b16-9821-35efd624bd5f None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:10.584534 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51a16b-fff5-4b16-9821-35efd624bd5f None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:10.584807 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51a16b-fff5-4b16-9821-35efd624bd5f None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:10.585494 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51a16b-fff5-4b16-9821-35efd624bd5f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:10.585801 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51a16b-fff5-4b16-9821-35efd624bd5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:10.587167 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51a16b-fff5-4b16-9821-35efd624bd5f None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:10.592955 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 462/923] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Jul 27 18:53:10 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:10.598824 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f12fd-cda9-4518-8d7e-5a56613959c9 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:10.638018 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:10.711747 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f12fd-cda9-4518-8d7e-5a56613959c9 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:10.740193 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a47104-e1c3-410c-96ac-0d722682974f None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:10.740526 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a47104-e1c3-410c-96ac-0d722682974f None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:10.740809 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a47104-e1c3-410c-96ac-0d722682974f None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:10.742924 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 463/924] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:53:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:53:10.747654 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10031115-a447-42e2-b43a-8ebca5953059 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:10.747971 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10031115-a447-42e2-b43a-8ebca5953059 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:10.748247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10031115-a447-42e2-b43a-8ebca5953059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:10.750329 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5bd357-357a-455e-b091-ed7dfdcc08b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:10.751209 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5bd357-357a-455e-b091-ed7dfdcc08b3 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:10.751718 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5bd357-357a-455e-b091-ed7dfdcc08b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:10.752204 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5bd357-357a-455e-b091-ed7dfdcc08b3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:10.753178 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5bd357-357a-455e-b091-ed7dfdcc08b3 None admin] RBAC: Adding query filter params (interface=public, service_id=dd7911bc1f514ccbaebd10a5539bad2d, region_id=RegionOne) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:10.753494 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5bd357-357a-455e-b091-ed7dfdcc08b3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:10.754854 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5bd357-357a-455e-b091-ed7dfdcc08b3 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:10.760921 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 462/925] 10.222.0.20 () {56 vars in 1251 bytes} [Wed Jul 27 18:53:10 2022] GET /identity/v3/endpoints?service_id=dd7911bc1f514ccbaebd10a5539bad2d&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:10.767918 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-10031115-a447-42e2-b43a-8ebca5953059 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:53:10.768964 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5bd357-357a-455e-b091-ed7dfdcc08b3 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:10.769489 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-10031115-a447-42e2-b43a-8ebca5953059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:10.844500 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 464/926] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:53:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:53:10.867610 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10031115-a447-42e2-b43a-8ebca5953059 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:10.886631 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:10.892705 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5bd357-357a-455e-b091-ed7dfdcc08b3 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:10.922406 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:10.935709 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c98f196-7abb-498d-abde-ddc8f2c83463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:10.935709 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98f196-7abb-498d-abde-ddc8f2c83463 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:10.935709 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98f196-7abb-498d-abde-ddc8f2c83463 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:10.935709 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98f196-7abb-498d-abde-ddc8f2c83463 None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:10.936145 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c98f196-7abb-498d-abde-ddc8f2c83463 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:10.936145 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c98f196-7abb-498d-abde-ddc8f2c83463 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:10.943224 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 463/927] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Jul 27 18:53:10 2022] GET /identity/v3/services => generated 1497 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:53:10.980928 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10031115-a447-42e2-b43a-8ebca5953059 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:11.020228 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a435f6-71a9-43a4-b83f-1fc446cea285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:11.020896 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a435f6-71a9-43a4-b83f-1fc446cea285 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:11.021178 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a435f6-71a9-43a4-b83f-1fc446cea285 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:11.021451 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a435f6-71a9-43a4-b83f-1fc446cea285 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:11.022652 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a435f6-71a9-43a4-b83f-1fc446cea285 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:11.024079 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a435f6-71a9-43a4-b83f-1fc446cea285 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:11.034025 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-18a435f6-71a9-43a4-b83f-1fc446cea285 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 18:53:11.034025 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:11.034025 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:53:11.034025 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:53:11.034025 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:53:11.034025 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:53:11.034025 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:53:11.034025 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:53:11.034025 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 18:53:11.034025 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:11.034025 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:53:11.034025 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:11.034025 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:11.034025 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:11.034025 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:11.034025 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:11.035250 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:11.035250 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:11.035250 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:11.035250 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:11.035250 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:11.035250 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:11.035250 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:11.035250 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:53:11.035250 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:53:11.035250 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:53:11.035250 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:53:11.035250 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:11.035250 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:11.035250 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:11.035250 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:11.035250 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:11.036451 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:11.036451 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:11.036451 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:11.036451 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:11.036451 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:11.036451 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:11.036451 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:11.036451 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:11.036451 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:11.036451 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:11.036451 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:11.036451 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:53:11.036451 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:53:11.036451 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 18:53:11.036451 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:11.036451 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 465/928] 10.222.0.20 () {56 vars in 1132 bytes} [Wed Jul 27 18:53:10 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:53:11.044374 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c98f196-7abb-498d-abde-ddc8f2c83463 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:11.151962 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c98f196-7abb-498d-abde-ddc8f2c83463 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:11.185310 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09fa8a5-f745-43cb-8b18-d12d0b958f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:11.185928 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fa8a5-f745-43cb-8b18-d12d0b958f90 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:11.186212 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fa8a5-f745-43cb-8b18-d12d0b958f90 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:11.186487 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fa8a5-f745-43cb-8b18-d12d0b958f90 None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:11.187162 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09fa8a5-f745-43cb-8b18-d12d0b958f90 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:11.187468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09fa8a5-f745-43cb-8b18-d12d0b958f90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:11.188854 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09fa8a5-f745-43cb-8b18-d12d0b958f90 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:11.193793 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 464/929] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Jul 27 18:53:11 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:11.199466 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a435f6-71a9-43a4-b83f-1fc446cea285 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:11.306621 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a435f6-71a9-43a4-b83f-1fc446cea285 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:11.320781 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:11.342428 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c3977-97f2-4c24-a97d-bab0931e5caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:11.343045 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c3977-97f2-4c24-a97d-bab0931e5caf None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:11.343326 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c3977-97f2-4c24-a97d-bab0931e5caf None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:11.343599 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c3977-97f2-4c24-a97d-bab0931e5caf None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:11.344312 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333c3977-97f2-4c24-a97d-bab0931e5caf None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:11.344619 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333c3977-97f2-4c24-a97d-bab0931e5caf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:11.345976 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333c3977-97f2-4c24-a97d-bab0931e5caf None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:11.351312 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 466/930] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Jul 27 18:53:11 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:11.357030 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09fa8a5-f745-43cb-8b18-d12d0b958f90 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:11.385192 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:11.465963 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09fa8a5-f745-43cb-8b18-d12d0b958f90 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:11.504519 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0edebb-15c9-4bdd-80c4-f7694270c985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:11.505134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0edebb-15c9-4bdd-80c4-f7694270c985 None admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:11.505414 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0edebb-15c9-4bdd-80c4-f7694270c985 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:11.505683 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0edebb-15c9-4bdd-80c4-f7694270c985 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:11.506417 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0edebb-15c9-4bdd-80c4-f7694270c985 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:11.507792 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0edebb-15c9-4bdd-80c4-f7694270c985 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:11.542839 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 465/931] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Jul 27 18:53:11 2022] POST /identity/v3/endpoints => generated 347 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:53:11.936573 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59aaddf-5865-4399-b8b1-0f68a40ecece None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:11.937134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59aaddf-5865-4399-b8b1-0f68a40ecece None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:11.937134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59aaddf-5865-4399-b8b1-0f68a40ecece None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:11.938706 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 467/932] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:53:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:53:11.944612 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1222af8-69e8-4614-a753-16dbc2682abf None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:11.945054 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1222af8-69e8-4614-a753-16dbc2682abf None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:11.945221 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1222af8-69e8-4614-a753-16dbc2682abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:11.963081 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-c1222af8-69e8-4614-a753-16dbc2682abf None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:53:11.964287 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-c1222af8-69e8-4614-a753-16dbc2682abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:12.040351 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 466/933] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:53:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:53:12.064121 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59aaddf-5865-4399-b8b1-0f68a40ecece None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:12.174264 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59aaddf-5865-4399-b8b1-0f68a40ecece None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:12.208801 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c35f7bf-7261-4386-bc2e-964c474a81ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:12.209349 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35f7bf-7261-4386-bc2e-964c474a81ef None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:12.209665 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35f7bf-7261-4386-bc2e-964c474a81ef None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:12.209942 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35f7bf-7261-4386-bc2e-964c474a81ef None admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:12.210628 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c35f7bf-7261-4386-bc2e-964c474a81ef None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:12.212079 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c35f7bf-7261-4386-bc2e-964c474a81ef None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:12.214762 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: WARNING keystone.server.flask.common [None req-0c35f7bf-7261-4386-bc2e-964c474a81ef None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 27 18:53:12.233869 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.sql.core [None req-0c35f7bf-7261-4386-bc2e-964c474a81ef None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 27 18:53:12.233869 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 27 18:53:12.233869 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [parameters: {'id': '826e749addd54536bfef3755b3ef3813', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 27 18:53:12.233869 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80076) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 27 18:53:12.241829 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-0c35f7bf-7261-4386-bc2e-964c474a81ef None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 826e749addd54536bfef3755b3ef3813.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 826e749addd54536bfef3755b3ef3813. Jul 27 18:53:12.241829 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:12.241829 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 18:53:12.241829 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 18:53:12.241829 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 18:53:12.241829 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 18:53:12.241829 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 18:53:12.241829 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 18:53:12.241829 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 18:53:12.241829 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application conn.query(q) Jul 27 18:53:12.241829 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 18:53:12.241829 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 18:53:12.241829 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 18:53:12.242674 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application result.read() Jul 27 18:53:12.242674 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 18:53:12.242674 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 18:53:12.242674 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 18:53:12.242674 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 18:53:12.242674 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 18:53:12.242674 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 18:53:12.242674 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 18:53:12.242674 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 18:53:12.242674 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 27 18:53:12.242674 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:12.242674 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 27 18:53:12.242674 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:12.242674 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:12.242674 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 27 18:53:12.242674 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 27 18:53:12.242674 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 27 18:53:12.242674 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 27 18:53:12.244172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 18:53:12.244172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application next(self.gen) Jul 27 18:53:12.244172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 27 18:53:12.244172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application yield resource Jul 27 18:53:12.244172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 18:53:12.244172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application next(self.gen) Jul 27 18:53:12.244172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 27 18:53:12.244172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application self.session.rollback() Jul 27 18:53:12.244172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 27 18:53:12.244172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application self.force_reraise() Jul 27 18:53:12.244172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 27 18:53:12.244172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise self.value Jul 27 18:53:12.244172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 27 18:53:12.244172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 27 18:53:12.244172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 27 18:53:12.244172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application session.commit() Jul 27 18:53:12.244172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 27 18:53:12.246309 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 27 18:53:12.246309 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 27 18:53:12.246309 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._prepare_impl() Jul 27 18:53:12.246309 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 27 18:53:12.246309 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application self.session.flush() Jul 27 18:53:12.246309 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 27 18:53:12.246309 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._flush(objects) Jul 27 18:53:12.246309 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 27 18:53:12.246309 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 27 18:53:12.246309 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 27 18:53:12.246309 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application compat.raise_( Jul 27 18:53:12.246309 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 18:53:12.246309 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception Jul 27 18:53:12.246309 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 27 18:53:12.246309 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application flush_context.execute() Jul 27 18:53:12.246309 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 27 18:53:12.246309 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rec.execute(self) Jul 27 18:53:12.250391 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 27 18:53:12.250391 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 27 18:53:12.250391 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 27 18:53:12.250391 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 27 18:53:12.250391 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 27 18:53:12.250391 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 27 18:53:12.250391 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 27 18:53:12.250391 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 27 18:53:12.250391 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 27 18:53:12.250391 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 27 18:53:12.250391 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 27 18:53:12.250391 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 27 18:53:12.250391 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 27 18:53:12.250391 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 27 18:53:12.250391 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 27 18:53:12.253655 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 27 18:53:12.253655 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 18:53:12.253655 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception Jul 27 18:53:12.253655 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 18:53:12.253655 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 18:53:12.253655 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 18:53:12.253655 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 18:53:12.253655 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 18:53:12.253655 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 18:53:12.253655 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 18:53:12.253655 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application conn.query(q) Jul 27 18:53:12.253655 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 18:53:12.253655 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 18:53:12.253655 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 18:53:12.253655 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application result.read() Jul 27 18:53:12.253655 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 18:53:12.253655 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 18:53:12.255795 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 18:53:12.255795 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 18:53:12.255795 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 18:53:12.255795 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 18:53:12.255795 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 18:53:12.255795 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 18:53:12.255795 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 27 18:53:12.255795 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 27 18:53:12.255795 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [parameters: {'id': '826e749addd54536bfef3755b3ef3813', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 27 18:53:12.255795 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 27 18:53:12.255795 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:12.255795 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:53:12.255795 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:12.255795 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:12.255795 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 27 18:53:12.260379 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 27 18:53:12.260379 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 27 18:53:12.260379 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 27 18:53:12.260379 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 27 18:53:12.260379 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:12.260379 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:53:12.260379 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:12.260379 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:12.260379 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:12.260379 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:12.260379 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:12.260379 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:12.260379 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:12.260379 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:12.260379 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:12.260379 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:12.260379 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:12.261318 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:12.261318 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 27 18:53:12.261318 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 27 18:53:12.261318 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:12.261318 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:12.261318 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 27 18:53:12.261318 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 27 18:53:12.261318 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 826e749addd54536bfef3755b3ef3813. Jul 27 18:53:12.261318 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:12.261318 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 468/934] 10.222.0.20 () {60 vars in 1140 bytes} [Wed Jul 27 18:53:12 2022] POST /identity/v3/projects => generated 262 bytes in 180 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:53:12.261873 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1222af8-69e8-4614-a753-16dbc2682abf None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:12.261873 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:12.356551 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1222af8-69e8-4614-a753-16dbc2682abf None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:12.403296 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1a73d-3a1a-44b8-85d0-20d868a91872 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:12.407709 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1a73d-3a1a-44b8-85d0-20d868a91872 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:12.407709 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1a73d-3a1a-44b8-85d0-20d868a91872 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:12.409279 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 469/935] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:53:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:53:12.421091 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fcf6eb-86c4-405f-88fe-7312a526b5d4 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:12.421376 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fcf6eb-86c4-405f-88fe-7312a526b5d4 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:12.421654 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fcf6eb-86c4-405f-88fe-7312a526b5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:12.435590 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5168de-a076-4b38-80ba-9009cb599d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:12.440278 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5168de-a076-4b38-80ba-9009cb599d51 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:12.440558 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5168de-a076-4b38-80ba-9009cb599d51 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:12.440834 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5168de-a076-4b38-80ba-9009cb599d51 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:12.454298 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5168de-a076-4b38-80ba-9009cb599d51 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:12.455794 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5168de-a076-4b38-80ba-9009cb599d51 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:12.460570 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-97fcf6eb-86c4-405f-88fe-7312a526b5d4 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:53:12.462025 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-97fcf6eb-86c4-405f-88fe-7312a526b5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:12.477834 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-1f5168de-a076-4b38-80ba-9009cb599d51 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:53:12.477834 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:12.477834 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:12.477834 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:12.477834 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:12.477834 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:12.477834 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:12.477834 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:12.477834 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:12.477834 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:12.477834 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:12.477834 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:12.477834 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:53:12.477834 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:53:12.477834 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:53:12.478747 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:53:12.478747 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:12.478747 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:12.478747 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:12.478747 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:12.478747 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:12.478747 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:12.478747 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:12.478747 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:12.478747 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:12.478747 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:12.478747 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:12.478747 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:12.478747 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:12.478747 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:12.478747 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:12.478747 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:12.479603 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:53:12.479603 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:53:12.479603 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:53:12.479603 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:53:12.479603 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:53:12.479603 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:53:12.479603 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:53:12.479603 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:53:12.495597 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 467/936] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 27 18:53:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:53:12.498467 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5168de-a076-4b38-80ba-9009cb599d51 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:12.532044 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:12.603943 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 470/937] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:53:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 18:53:12.621125 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fcf6eb-86c4-405f-88fe-7312a526b5d4 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:12.621727 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:12.685360 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5168de-a076-4b38-80ba-9009cb599d51 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:12.745111 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fcf6eb-86c4-405f-88fe-7312a526b5d4 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:12.777953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a64859-b7cb-4abc-9852-392bf3236085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:12.778573 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a64859-b7cb-4abc-9852-392bf3236085 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:12.778906 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a64859-b7cb-4abc-9852-392bf3236085 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:12.779183 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a64859-b7cb-4abc-9852-392bf3236085 None admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:12.779932 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a64859-b7cb-4abc-9852-392bf3236085 None admin] RBAC: Adding query filter params (name=service) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:12.780236 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a64859-b7cb-4abc-9852-392bf3236085 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:12.781677 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a64859-b7cb-4abc-9852-392bf3236085 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:12.812290 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b44064f-728e-49f3-a2b0-ab12a4a865cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:12.812997 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44064f-728e-49f3-a2b0-ab12a4a865cb None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:12.813277 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44064f-728e-49f3-a2b0-ab12a4a865cb None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:12.813549 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44064f-728e-49f3-a2b0-ab12a4a865cb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:12.823901 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 468/938] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Jul 27 18:53:12 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:12.830030 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b44064f-728e-49f3-a2b0-ab12a4a865cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:53:12.835120 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-8b44064f-728e-49f3-a2b0-ab12a4a865cb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 18:53:12.835120 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:12.835120 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:12.835120 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:12.835120 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:12.835120 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:12.835120 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:12.835120 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:12.835120 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:12.835120 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:12.835120 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:12.835120 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:12.835120 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:53:12.835120 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:53:12.835120 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:53:12.835120 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:53:12.836095 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:53:12.836095 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:53:12.836095 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:53:12.836095 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:53:12.836095 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:12.836095 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:12.836095 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:12.836095 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:12.836095 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:12.836095 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:12.836095 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:12.836095 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:12.836095 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:12.836095 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:12.836095 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:12.836095 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:12.836928 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:12.836928 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:12.836928 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:12.836928 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:12.836928 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:53:12.836928 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:53:12.836928 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:53:12.836928 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:53:12.836928 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:53:12.836928 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:53:12.836928 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 18:53:12.836928 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:12.839831 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 471/939] 10.222.0.20 () {56 vars in 1120 bytes} [Wed Jul 27 18:53:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:53:12.849158 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a64859-b7cb-4abc-9852-392bf3236085 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:12.965751 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a64859-b7cb-4abc-9852-392bf3236085 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:12.995230 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:13.005228 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ad32e-72d3-4082-a9a0-5b726402475e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:13.005830 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ad32e-72d3-4082-a9a0-5b726402475e None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:13.006204 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ad32e-72d3-4082-a9a0-5b726402475e None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:13.006459 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ad32e-72d3-4082-a9a0-5b726402475e None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:13.007219 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ad32e-72d3-4082-a9a0-5b726402475e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:13.007532 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ad32e-72d3-4082-a9a0-5b726402475e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:13.008949 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ad32e-72d3-4082-a9a0-5b726402475e None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:13.017502 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 469/940] 10.222.0.20 () {56 vars in 1115 bytes} [Wed Jul 27 18:53:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:13.023157 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b44064f-728e-49f3-a2b0-ab12a4a865cb None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:13.056118 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:13.091093 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04260d-ff07-445b-81af-8e616aec7cae None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:13.091377 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04260d-ff07-445b-81af-8e616aec7cae None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:13.091659 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04260d-ff07-445b-81af-8e616aec7cae None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:13.093306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 470/941] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:53:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:53:13.099019 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce147577-23d7-4ee9-9955-58a4f94d1eec None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:13.099019 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce147577-23d7-4ee9-9955-58a4f94d1eec None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:13.099019 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce147577-23d7-4ee9-9955-58a4f94d1eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:13.119155 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-ce147577-23d7-4ee9-9955-58a4f94d1eec None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:53:13.120384 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-ce147577-23d7-4ee9-9955-58a4f94d1eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:13.160538 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b44064f-728e-49f3-a2b0-ab12a4a865cb None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:13.201960 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 471/942] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:53:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 18:53:13.210690 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2653ba-f428-4433-b0c6-f03102ec075a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:13.211334 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2653ba-f428-4433-b0c6-f03102ec075a None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:13.211611 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2653ba-f428-4433-b0c6-f03102ec075a None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:13.211905 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2653ba-f428-4433-b0c6-f03102ec075a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:13.222736 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2653ba-f428-4433-b0c6-f03102ec075a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:13.224379 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2653ba-f428-4433-b0c6-f03102ec075a None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:13.229195 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce147577-23d7-4ee9-9955-58a4f94d1eec None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:13.249783 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-bc2653ba-f428-4433-b0c6-f03102ec075a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:53:13.249783 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:13.249783 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:13.249783 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:13.249783 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:13.249783 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:13.249783 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:13.249783 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:13.249783 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:13.249783 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:13.249783 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:13.249783 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:13.249783 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:53:13.249783 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:53:13.249783 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:53:13.250723 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:53:13.250723 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:13.250723 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:13.250723 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:13.250723 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:13.250723 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:13.250723 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:13.250723 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:13.250723 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:13.250723 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:13.250723 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:13.250723 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:13.250723 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:13.250723 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:13.250723 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:13.250723 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:13.250723 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:13.251661 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:53:13.251661 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:53:13.251661 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:53:13.251661 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:13.254773 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 472/943] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:53:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:53:13.260609 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2653ba-f428-4433-b0c6-f03102ec075a None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:13.339145 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce147577-23d7-4ee9-9955-58a4f94d1eec None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:13.340810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:13.361290 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:13.366394 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2653ba-f428-4433-b0c6-f03102ec075a None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:13.381689 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510ea5f-490a-4a0d-83e5-a9c371201779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:13.382566 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510ea5f-490a-4a0d-83e5-a9c371201779 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:13.382988 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510ea5f-490a-4a0d-83e5-a9c371201779 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:13.383533 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510ea5f-490a-4a0d-83e5-a9c371201779 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:13.384472 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b510ea5f-490a-4a0d-83e5-a9c371201779 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:13.385970 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b510ea5f-490a-4a0d-83e5-a9c371201779 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:13.395742 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-b510ea5f-490a-4a0d-83e5-a9c371201779 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 18:53:13.395742 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:13.395742 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:53:13.395742 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:53:13.395742 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:53:13.395742 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:53:13.395742 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:53:13.395742 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:53:13.395742 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 18:53:13.395742 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:53:13.395742 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:53:13.395742 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:53:13.395742 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:13.395742 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:13.395742 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:13.395742 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:13.395742 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:13.397425 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:13.397425 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:13.397425 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:13.397425 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:13.397425 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:13.397425 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:13.397425 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:53:13.397425 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:53:13.397425 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:53:13.397425 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:53:13.397425 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:13.397425 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:13.397425 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:13.397425 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:13.397425 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:13.397425 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:13.398448 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:13.398448 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:13.398448 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:13.398448 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:13.398448 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:13.398448 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:13.398448 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:13.398448 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:13.398448 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:13.398448 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:13.398448 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:53:13.398448 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:53:13.398448 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 18:53:13.398448 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:53:13.401072 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 472/944] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Jul 27 18:53:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:53:13.406674 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510ea5f-490a-4a0d-83e5-a9c371201779 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:13.408541 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395ce025-e89a-41ba-89df-628cd044dd8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:13.409160 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ce025-e89a-41ba-89df-628cd044dd8f None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:13.409432 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ce025-e89a-41ba-89df-628cd044dd8f None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:13.409700 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ce025-e89a-41ba-89df-628cd044dd8f None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:13.410397 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395ce025-e89a-41ba-89df-628cd044dd8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:13.411035 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395ce025-e89a-41ba-89df-628cd044dd8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:13.412412 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395ce025-e89a-41ba-89df-628cd044dd8f None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:13.430094 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 473/945] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:53:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:53:13.435425 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395ce025-e89a-41ba-89df-628cd044dd8f None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:13.537939 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510ea5f-490a-4a0d-83e5-a9c371201779 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:13.559669 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395ce025-e89a-41ba-89df-628cd044dd8f None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:13.578720 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8e4e0-4d3c-46b6-98e4-d6595ab0a0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:13.579725 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8e4e0-4d3c-46b6-98e4-d6595ab0a0eb None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:13.580234 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8e4e0-4d3c-46b6-98e4-d6595ab0a0eb None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:13.580711 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8e4e0-4d3c-46b6-98e4-d6595ab0a0eb None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:13.582416 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a8e4e0-4d3c-46b6-98e4-d6595ab0a0eb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:13.582929 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a8e4e0-4d3c-46b6-98e4-d6595ab0a0eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:13.584559 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a8e4e0-4d3c-46b6-98e4-d6595ab0a0eb None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:13.589985 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 473/946] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Jul 27 18:53:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:13.595701 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8e4e0-4d3c-46b6-98e4-d6595ab0a0eb None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:13.608046 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d4bb2a-ab29-4596-bdcd-0f09155ef009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:13.609022 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4bb2a-ab29-4596-bdcd-0f09155ef009 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:13.609527 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4bb2a-ab29-4596-bdcd-0f09155ef009 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:13.610268 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4bb2a-ab29-4596-bdcd-0f09155ef009 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:13.619103 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d4bb2a-ab29-4596-bdcd-0f09155ef009 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:13.620931 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d4bb2a-ab29-4596-bdcd-0f09155ef009 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:13.624086 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:13.636959 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-b2d4bb2a-ab29-4596-bdcd-0f09155ef009 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 18:53:13.636959 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:13.636959 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:13.636959 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:13.636959 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:13.636959 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:13.636959 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:13.636959 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:13.636959 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:13.636959 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:13.636959 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:13.636959 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:13.636959 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:53:13.636959 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:53:13.636959 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:53:13.636959 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:53:13.637952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:13.637952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:13.637952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:53:13.637952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:53:13.637952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:53:13.637952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:53:13.637952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:13.637952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:13.637952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:13.637952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:13.637952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:13.637952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:13.637952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:13.637952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:13.637952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:13.637952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:13.637952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:13.637952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:13.638980 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:13.638980 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:13.638980 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:53:13.638980 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:53:13.638980 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:53:13.638980 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:53:13.638980 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:53:13.638980 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:53:13.638980 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 18:53:13.638980 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:13.641593 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 474/947] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Jul 27 18:53:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:53:13.649315 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d4bb2a-ab29-4596-bdcd-0f09155ef009 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:13.657604 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:13.717535 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8e4e0-4d3c-46b6-98e4-d6595ab0a0eb None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:13.754241 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5dd026-702c-4a37-b0db-24c8307849b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:13.754937 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5dd026-702c-4a37-b0db-24c8307849b6 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:13.755215 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5dd026-702c-4a37-b0db-24c8307849b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:13.755486 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5dd026-702c-4a37-b0db-24c8307849b6 None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:13.756223 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5dd026-702c-4a37-b0db-24c8307849b6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:13.756493 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5dd026-702c-4a37-b0db-24c8307849b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:13.756815 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d4bb2a-ab29-4596-bdcd-0f09155ef009 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:13.757855 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5dd026-702c-4a37-b0db-24c8307849b6 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:13.768075 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 474/948] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Jul 27 18:53:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:53:13.768075 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e64a2a-fb63-4f63-9d3a-e55aa7869947 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:13.768075 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e64a2a-fb63-4f63-9d3a-e55aa7869947 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:13.768075 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e64a2a-fb63-4f63-9d3a-e55aa7869947 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:13.768075 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 475/949] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:53:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:53:13.771032 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e64a2a-fb63-4f63-9d3a-e55aa7869947 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:13.806831 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa59a4f5-b8c4-4738-835a-9c69c7cce61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:13.807697 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59a4f5-b8c4-4738-835a-9c69c7cce61b None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:13.807979 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59a4f5-b8c4-4738-835a-9c69c7cce61b None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:13.808251 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59a4f5-b8c4-4738-835a-9c69c7cce61b None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:13.809038 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa59a4f5-b8c4-4738-835a-9c69c7cce61b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:13.809356 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa59a4f5-b8c4-4738-835a-9c69c7cce61b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:13.810748 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa59a4f5-b8c4-4738-835a-9c69c7cce61b None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:13.828727 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 475/950] 10.222.0.20 () {56 vars in 1149 bytes} [Wed Jul 27 18:53:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:53:13.834172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22f197-e4ff-4ebf-8551-dd9526abd4e8 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:13.834492 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22f197-e4ff-4ebf-8551-dd9526abd4e8 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:13.834771 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22f197-e4ff-4ebf-8551-dd9526abd4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:13.852515 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-9e22f197-e4ff-4ebf-8551-dd9526abd4e8 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:53:13.853700 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-9e22f197-e4ff-4ebf-8551-dd9526abd4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:13.884722 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e64a2a-fb63-4f63-9d3a-e55aa7869947 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:13.894751 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:13.907975 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:13.922160 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1221ff9b-1dbe-4f21-b8d4-0d561fefb42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:13.923326 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221ff9b-1dbe-4f21-b8d4-0d561fefb42e None admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:13.923879 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221ff9b-1dbe-4f21-b8d4-0d561fefb42e None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:13.924404 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221ff9b-1dbe-4f21-b8d4-0d561fefb42e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:13.925302 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1221ff9b-1dbe-4f21-b8d4-0d561fefb42e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:13.926252 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 476/951] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:53:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:53:13.927057 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22f197-e4ff-4ebf-8551-dd9526abd4e8 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:13.927484 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1221ff9b-1dbe-4f21-b8d4-0d561fefb42e None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:13.956570 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 476/952] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Jul 27 18:53:13 2022] POST /identity/v3/endpoints => generated 349 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:53:13.969056 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1221ff9b-1dbe-4f21-b8d4-0d561fefb42e None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:14.048763 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22f197-e4ff-4ebf-8551-dd9526abd4e8 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:14.098679 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725904a-0aa1-4ca9-984a-efbc94e65d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:14.099745 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725904a-0aa1-4ca9-984a-efbc94e65d05 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:14.100796 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725904a-0aa1-4ca9-984a-efbc94e65d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:14.101290 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725904a-0aa1-4ca9-984a-efbc94e65d05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:14.104661 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1221ff9b-1dbe-4f21-b8d4-0d561fefb42e None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:14.114391 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8725904a-0aa1-4ca9-984a-efbc94e65d05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:14.116292 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8725904a-0aa1-4ca9-984a-efbc94e65d05 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:14.134677 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-8725904a-0aa1-4ca9-984a-efbc94e65d05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:53:14.134677 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:14.134677 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:14.134677 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:14.134677 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:14.134677 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:14.134677 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:14.134677 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:14.134677 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:14.134677 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:14.134677 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:14.134677 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:14.134677 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:53:14.134677 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:53:14.134677 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:53:14.135622 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:53:14.135622 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:14.135622 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:14.135622 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:14.135622 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:14.135622 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:14.135622 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:14.135622 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:14.135622 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:14.135622 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:14.135622 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:14.135622 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:14.135622 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:14.135622 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:14.135622 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:14.135622 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:14.135622 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:14.136566 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:53:14.136566 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:53:14.136566 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:53:14.136566 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:14.136566 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 477/953] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:53:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:53:14.140627 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725904a-0aa1-4ca9-984a-efbc94e65d05 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:14.153473 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798c122-01d4-43cc-b7ed-f12d9d17997d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:14.154209 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798c122-01d4-43cc-b7ed-f12d9d17997d None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:14.154492 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798c122-01d4-43cc-b7ed-f12d9d17997d None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:14.154764 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798c122-01d4-43cc-b7ed-f12d9d17997d None admin] PATH_INFO: `/v3/services/compute` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:14.155386 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d798c122-01d4-43cc-b7ed-f12d9d17997d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:14.156912 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d798c122-01d4-43cc-b7ed-f12d9d17997d None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:14.167179 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-d798c122-01d4-43cc-b7ed-f12d9d17997d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 18:53:14.167179 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:14.167179 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:53:14.167179 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:53:14.167179 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:53:14.167179 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:53:14.167179 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:53:14.167179 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:53:14.167179 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 18:53:14.167179 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:53:14.167179 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:53:14.167179 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:53:14.167179 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:14.167179 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:14.167179 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:14.167179 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:14.167179 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:14.168245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:14.168245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:14.168245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:14.168245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:14.168245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:14.168245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:14.168245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:53:14.168245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:53:14.168245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:53:14.168245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:53:14.168245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:14.168245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:14.168245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:14.168245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:14.168245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:14.168245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:14.169256 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:14.169256 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:14.169256 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:14.169256 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:14.169256 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:14.169256 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:14.169256 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:14.169256 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:14.169256 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:14.169256 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:14.169256 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:53:14.169256 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:53:14.169256 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 18:53:14.169256 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:53:14.169256 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 477/954] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 27 18:53:13 2022] GET /identity/v3/services/compute => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:53:14.175494 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798c122-01d4-43cc-b7ed-f12d9d17997d None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:14.181380 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:14.244092 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:14.272630 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725904a-0aa1-4ca9-984a-efbc94e65d05 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:14.286163 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798c122-01d4-43cc-b7ed-f12d9d17997d None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:14.308743 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f5f3c-ad6f-42b3-849c-860f70928d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:14.309502 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f5f3c-ad6f-42b3-849c-860f70928d45 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:14.309904 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f5f3c-ad6f-42b3-849c-860f70928d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:14.310280 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f5f3c-ad6f-42b3-849c-860f70928d45 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:14.311043 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9f5f3c-ad6f-42b3-849c-860f70928d45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:14.311414 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9f5f3c-ad6f-42b3-849c-860f70928d45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:14.312965 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9f5f3c-ad6f-42b3-849c-860f70928d45 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:14.324837 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d62cb4-4948-458f-a415-27d3fe748385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:14.325545 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d62cb4-4948-458f-a415-27d3fe748385 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:14.325910 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d62cb4-4948-458f-a415-27d3fe748385 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:14.326256 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d62cb4-4948-458f-a415-27d3fe748385 None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:14.326775 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 478/955] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:53:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:14.327113 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d62cb4-4948-458f-a415-27d3fe748385 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:14.327828 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d62cb4-4948-458f-a415-27d3fe748385 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:14.329296 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d62cb4-4948-458f-a415-27d3fe748385 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:14.331916 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f5f3c-ad6f-42b3-849c-860f70928d45 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:14.335269 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 478/956] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Jul 27 18:53:14 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:53:14.340605 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d62cb4-4948-458f-a415-27d3fe748385 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:14.445237 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:14.451243 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:14.454321 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d62cb4-4948-458f-a415-27d3fe748385 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:14.464359 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f5f3c-ad6f-42b3-849c-860f70928d45 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:14.498195 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c638e5-3437-4507-96cc-81186ee6649a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:14.498966 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c638e5-3437-4507-96cc-81186ee6649a None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:14.499345 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c638e5-3437-4507-96cc-81186ee6649a None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:14.499931 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c638e5-3437-4507-96cc-81186ee6649a None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:14.500753 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c638e5-3437-4507-96cc-81186ee6649a None admin] RBAC: Adding query filter params (type=compute) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:14.501159 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c638e5-3437-4507-96cc-81186ee6649a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:14.502620 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c638e5-3437-4507-96cc-81186ee6649a None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:14.505763 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d327fcef-891e-4763-8502-fadadf10b6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:14.507205 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327fcef-891e-4763-8502-fadadf10b6d9 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:14.507708 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327fcef-891e-4763-8502-fadadf10b6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:14.508180 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327fcef-891e-4763-8502-fadadf10b6d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:14.511855 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 479/957] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Jul 27 18:53:14 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:14.524130 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d327fcef-891e-4763-8502-fadadf10b6d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:14.526037 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d327fcef-891e-4763-8502-fadadf10b6d9 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:14.542533 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-d327fcef-891e-4763-8502-fadadf10b6d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:53:14.542533 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:14.542533 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:14.542533 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:14.542533 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:14.542533 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:14.542533 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:14.542533 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:14.542533 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:14.542533 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:14.542533 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:14.542533 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:14.542533 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:53:14.542533 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:53:14.542533 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:53:14.543579 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:53:14.543579 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:14.543579 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:14.543579 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:14.543579 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:14.543579 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:14.543579 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:14.543579 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:14.543579 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:14.543579 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:14.543579 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:14.543579 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:14.543579 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:14.543579 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:14.543579 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:14.543579 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:14.543579 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:14.544510 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:53:14.544510 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:53:14.544510 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:53:14.544510 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:53:14.544510 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:53:14.544510 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:53:14.544510 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:53:14.544510 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:14.547115 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 479/958] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 27 18:53:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:53:14.552615 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c638e5-3437-4507-96cc-81186ee6649a None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:14.668317 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c638e5-3437-4507-96cc-81186ee6649a None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:14.704051 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a323ba3-bcab-4d46-9a6c-188d42d94cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:14.704588 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a323ba3-bcab-4d46-9a6c-188d42d94cbc None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:14.704865 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a323ba3-bcab-4d46-9a6c-188d42d94cbc None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:14.705135 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a323ba3-bcab-4d46-9a6c-188d42d94cbc None admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:14.705886 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a323ba3-bcab-4d46-9a6c-188d42d94cbc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:14.706192 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a323ba3-bcab-4d46-9a6c-188d42d94cbc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:14.707600 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a323ba3-bcab-4d46-9a6c-188d42d94cbc None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:14.721843 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 480/959] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 27 18:53:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:53:14.727831 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d327fcef-891e-4763-8502-fadadf10b6d9 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:14.830508 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d327fcef-891e-4763-8502-fadadf10b6d9 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:14.864161 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377f9b09-ac66-431b-98c8-07e1dc3c4900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:14.864824 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f9b09-ac66-431b-98c8-07e1dc3c4900 None admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:14.865099 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f9b09-ac66-431b-98c8-07e1dc3c4900 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:14.865370 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f9b09-ac66-431b-98c8-07e1dc3c4900 None admin] PATH_INFO: `/v3/projects/31f027c53398443eb548eaf3f24523e0/users/a277ddae777442869114c4c5deff7d7e/roles/f388f0bd9c714f86a7657d98f844d701` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:14.868162 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377f9b09-ac66-431b-98c8-07e1dc3c4900 None admin] RBAC: Authorizing `identity:create_grant(project_id=31f027c53398443eb548eaf3f24523e0, user_id=a277ddae777442869114c4c5deff7d7e, role_id=f388f0bd9c714f86a7657d98f844d701)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:14.869589 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377f9b09-ac66-431b-98c8-07e1dc3c4900 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:14.884650 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 480/960] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 27 18:53:14 2022] PUT /identity/v3/projects/31f027c53398443eb548eaf3f24523e0/users/a277ddae777442869114c4c5deff7d7e/roles/f388f0bd9c714f86a7657d98f844d701 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:53:15.018037 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c8b7f-ed83-45f7-ab9a-a2b3dd2f2060 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:15.018539 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c8b7f-ed83-45f7-ab9a-a2b3dd2f2060 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:15.018539 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c8b7f-ed83-45f7-ab9a-a2b3dd2f2060 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:15.020181 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 481/961] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:53:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:53:15.025651 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811b3bf-62f8-4427-ac73-1c487b967de3 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:15.026221 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811b3bf-62f8-4427-ac73-1c487b967de3 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:15.026712 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811b3bf-62f8-4427-ac73-1c487b967de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:15.048330 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-a811b3bf-62f8-4427-ac73-1c487b967de3 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:53:15.049908 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a811b3bf-62f8-4427-ac73-1c487b967de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:15.059659 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:15.144175 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 481/962] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:53:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:53:15.169057 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c8b7f-ed83-45f7-ab9a-a2b3dd2f2060 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:15.190102 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:15.278429 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c8b7f-ed83-45f7-ab9a-a2b3dd2f2060 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:15.313719 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328073e9-7211-41bb-acc9-03ac56c3ecf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:15.314337 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328073e9-7211-41bb-acc9-03ac56c3ecf1 None admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:15.314623 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328073e9-7211-41bb-acc9-03ac56c3ecf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:15.314896 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328073e9-7211-41bb-acc9-03ac56c3ecf1 None admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:15.315563 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328073e9-7211-41bb-acc9-03ac56c3ecf1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:15.317019 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328073e9-7211-41bb-acc9-03ac56c3ecf1 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:15.319561 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: WARNING keystone.server.flask.common [None req-328073e9-7211-41bb-acc9-03ac56c3ecf1 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 27 18:53:15.332220 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.sql.core [None req-328073e9-7211-41bb-acc9-03ac56c3ecf1 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 27 18:53:15.332220 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 27 18:53:15.332220 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [parameters: {'user_id': 'c32f6771bfcc464da06709d281821448', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 27 18:53:15.332220 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80075) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 27 18:53:15.348536 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-328073e9-7211-41bb-acc9-03ac56c3ecf1 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 27 18:53:15.348536 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:15.348536 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 18:53:15.348536 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 18:53:15.348536 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 18:53:15.348536 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 18:53:15.348536 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 18:53:15.348536 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 18:53:15.348536 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 18:53:15.348536 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application conn.query(q) Jul 27 18:53:15.348536 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 18:53:15.348536 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 18:53:15.348536 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 18:53:15.348536 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application result.read() Jul 27 18:53:15.348536 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 18:53:15.349427 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 18:53:15.349427 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 18:53:15.349427 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 18:53:15.349427 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 18:53:15.349427 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 18:53:15.349427 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 18:53:15.349427 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 18:53:15.349427 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 27 18:53:15.349427 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:53:15.349427 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 27 18:53:15.349427 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:53:15.349427 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:15.349427 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 27 18:53:15.349427 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 27 18:53:15.349427 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 27 18:53:15.349427 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 27 18:53:15.349427 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 18:53:15.349427 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application next(self.gen) Jul 27 18:53:15.350920 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 27 18:53:15.350920 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application yield resource Jul 27 18:53:15.350920 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 18:53:15.350920 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application next(self.gen) Jul 27 18:53:15.350920 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 27 18:53:15.350920 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application self.session.rollback() Jul 27 18:53:15.350920 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 27 18:53:15.350920 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application self.force_reraise() Jul 27 18:53:15.350920 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 27 18:53:15.350920 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise self.value Jul 27 18:53:15.350920 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 27 18:53:15.350920 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 27 18:53:15.350920 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 27 18:53:15.350920 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application session.commit() Jul 27 18:53:15.350920 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 27 18:53:15.350920 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 27 18:53:15.350920 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 27 18:53:15.351874 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application self._prepare_impl() Jul 27 18:53:15.351874 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 27 18:53:15.351874 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application self.session.flush() Jul 27 18:53:15.351874 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 27 18:53:15.351874 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application self._flush(objects) Jul 27 18:53:15.351874 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 27 18:53:15.351874 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 27 18:53:15.351874 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 27 18:53:15.351874 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application compat.raise_( Jul 27 18:53:15.351874 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 18:53:15.351874 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception Jul 27 18:53:15.351874 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 27 18:53:15.351874 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application flush_context.execute() Jul 27 18:53:15.351874 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 27 18:53:15.351874 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rec.execute(self) Jul 27 18:53:15.351874 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 27 18:53:15.351874 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 27 18:53:15.352748 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 27 18:53:15.352748 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 27 18:53:15.352748 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 27 18:53:15.352748 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 27 18:53:15.352748 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 27 18:53:15.352748 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 27 18:53:15.352748 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 27 18:53:15.352748 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 27 18:53:15.352748 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 27 18:53:15.352748 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 27 18:53:15.352748 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 27 18:53:15.352748 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 27 18:53:15.352748 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 27 18:53:15.352748 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 27 18:53:15.352748 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 18:53:15.352748 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception Jul 27 18:53:15.353576 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 18:53:15.353576 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 18:53:15.353576 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 18:53:15.353576 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 18:53:15.353576 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 18:53:15.353576 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 18:53:15.353576 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 18:53:15.353576 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application conn.query(q) Jul 27 18:53:15.353576 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 18:53:15.353576 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 18:53:15.353576 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 18:53:15.353576 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application result.read() Jul 27 18:53:15.353576 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 18:53:15.353576 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 18:53:15.353576 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 18:53:15.353576 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 18:53:15.354417 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 18:53:15.354417 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 18:53:15.354417 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 18:53:15.354417 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 18:53:15.354417 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 27 18:53:15.354417 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 27 18:53:15.354417 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [parameters: {'user_id': 'c32f6771bfcc464da06709d281821448', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 27 18:53:15.354417 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 27 18:53:15.354417 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:53:15.354417 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:53:15.354417 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:53:15.354417 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:15.354417 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:15.354417 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:15.354417 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:15.355214 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:15.355214 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:15.355214 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:15.355214 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:15.355214 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:15.355214 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:15.355214 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:15.355214 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 27 18:53:15.355214 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 27 18:53:15.355214 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:15.355214 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:15.355214 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:53:15.355214 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:53:15.355214 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:53:15.355214 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:53:15.355214 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 27 18:53:15.355214 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 27 18:53:15.359393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 27 18:53:15.359393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 27 18:53:15.359393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 27 18:53:15.359393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 27 18:53:15.359393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 27 18:53:15.359393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:53:15.359393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 482/963] 10.222.0.20 () {60 vars in 1131 bytes} [Wed Jul 27 18:53:15 2022] POST /identity/v3/users => generated 160 bytes in 182 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:53:15.360124 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a811b3bf-62f8-4427-ac73-1c487b967de3 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:15.461966 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a811b3bf-62f8-4427-ac73-1c487b967de3 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:15.499235 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56aa1fc-9c5b-4d01-9a47-ceb5250e6d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:15.500218 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56aa1fc-9c5b-4d01-9a47-ceb5250e6d6b None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:15.500653 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56aa1fc-9c5b-4d01-9a47-ceb5250e6d6b None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:15.501063 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56aa1fc-9c5b-4d01-9a47-ceb5250e6d6b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:15.508607 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56aa1fc-9c5b-4d01-9a47-ceb5250e6d6b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:15.510179 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56aa1fc-9c5b-4d01-9a47-ceb5250e6d6b None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:15.522345 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-e56aa1fc-9c5b-4d01-9a47-ceb5250e6d6b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 18:53:15.522345 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:15.522345 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:15.522345 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:15.522345 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:15.522345 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:15.522345 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:15.522345 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:15.522345 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:15.522345 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:15.522345 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:15.522345 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:15.522345 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:53:15.522345 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:53:15.522345 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:53:15.522345 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:53:15.523479 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:15.523479 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:15.523479 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:53:15.523479 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:53:15.523479 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:53:15.523479 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:53:15.523479 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:15.523479 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:15.523479 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:15.523479 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:15.523479 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:15.523479 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:15.523479 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:15.523479 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:15.523479 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:15.523479 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:15.523479 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:15.523479 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:15.524684 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:15.524684 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:15.524684 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:53:15.524684 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:53:15.524684 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:53:15.524684 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:53:15.524684 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:53:15.524684 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:53:15.524684 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 18:53:15.524684 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:15.526845 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 482/964] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 27 18:53:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:53:15.533080 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328073e9-7211-41bb-acc9-03ac56c3ecf1 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:15.628022 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:15.650248 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328073e9-7211-41bb-acc9-03ac56c3ecf1 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:15.684946 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f73ed9a-862d-4f07-b2be-ec55c36a2d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:15.685571 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f73ed9a-862d-4f07-b2be-ec55c36a2d1d None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:15.685852 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f73ed9a-862d-4f07-b2be-ec55c36a2d1d None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:15.686124 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f73ed9a-862d-4f07-b2be-ec55c36a2d1d None admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:15.686888 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f73ed9a-862d-4f07-b2be-ec55c36a2d1d None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:15.687192 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f73ed9a-862d-4f07-b2be-ec55c36a2d1d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:15.688881 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f73ed9a-862d-4f07-b2be-ec55c36a2d1d None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:15.728501 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 483/965] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 27 18:53:15 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:16.072971 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505c18b-fbb4-4825-aad7-dd9b86368cf9 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:16.073523 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505c18b-fbb4-4825-aad7-dd9b86368cf9 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:16.073523 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505c18b-fbb4-4825-aad7-dd9b86368cf9 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:16.075014 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 483/966] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:53:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:53:16.080395 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acef37f-a1a8-4520-bd10-363a57b6300d None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:16.080790 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acef37f-a1a8-4520-bd10-363a57b6300d None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:16.080951 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acef37f-a1a8-4520-bd10-363a57b6300d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:16.098921 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-1acef37f-a1a8-4520-bd10-363a57b6300d None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:53:16.100990 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-1acef37f-a1a8-4520-bd10-363a57b6300d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:16.168739 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 484/967] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:53:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:53:16.191592 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a505c18b-fbb4-4825-aad7-dd9b86368cf9 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:16.194527 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:16.297169 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a505c18b-fbb4-4825-aad7-dd9b86368cf9 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:16.329599 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7507c-0eb6-4eae-a33e-8c80f30aac43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:16.330160 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7507c-0eb6-4eae-a33e-8c80f30aac43 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:16.330440 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7507c-0eb6-4eae-a33e-8c80f30aac43 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:16.330710 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7507c-0eb6-4eae-a33e-8c80f30aac43 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:16.331324 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce7507c-0eb6-4eae-a33e-8c80f30aac43 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:16.332707 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce7507c-0eb6-4eae-a33e-8c80f30aac43 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:16.342054 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-cce7507c-0eb6-4eae-a33e-8c80f30aac43 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 18:53:16.342054 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:16.342054 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:53:16.342054 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:53:16.342054 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:53:16.342054 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:53:16.342054 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:53:16.342054 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:53:16.342054 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 18:53:16.342054 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:16.342054 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:53:16.342054 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:16.342054 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:16.342054 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:16.342054 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:16.342054 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:16.342054 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:16.343033 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:16.343033 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:16.343033 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:16.343033 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:16.343033 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:16.343033 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:16.343033 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:53:16.343033 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:53:16.343033 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:53:16.343033 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:53:16.343033 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:16.343033 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:16.343033 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:16.343033 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:16.343033 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:16.343033 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:16.343890 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:16.343890 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:16.343890 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:16.343890 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:16.343890 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:16.343890 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:16.343890 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:16.343890 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:16.343890 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:16.343890 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:16.343890 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:53:16.343890 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:53:16.343890 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 18:53:16.343890 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:16.347756 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 484/968] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Jul 27 18:53:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:53:16.349727 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acef37f-a1a8-4520-bd10-363a57b6300d None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:16.415598 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:16.449353 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acef37f-a1a8-4520-bd10-363a57b6300d None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:16.487968 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b39c1-f14a-48a2-961a-51e08d673157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:16.488588 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b39c1-f14a-48a2-961a-51e08d673157 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:16.488866 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b39c1-f14a-48a2-961a-51e08d673157 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:16.489166 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b39c1-f14a-48a2-961a-51e08d673157 None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:16.489802 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b39c1-f14a-48a2-961a-51e08d673157 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:16.490105 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b39c1-f14a-48a2-961a-51e08d673157 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:16.491492 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b39c1-f14a-48a2-961a-51e08d673157 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:16.503193 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 485/969] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Jul 27 18:53:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:16.506731 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7507c-0eb6-4eae-a33e-8c80f30aac43 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:16.588503 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:16.625200 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7507c-0eb6-4eae-a33e-8c80f30aac43 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:16.660438 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef921ddd-1589-4dfb-b297-2bdab756e664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:16.661059 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef921ddd-1589-4dfb-b297-2bdab756e664 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:16.661342 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef921ddd-1589-4dfb-b297-2bdab756e664 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:16.661618 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef921ddd-1589-4dfb-b297-2bdab756e664 None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:16.662910 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef921ddd-1589-4dfb-b297-2bdab756e664 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:16.663224 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef921ddd-1589-4dfb-b297-2bdab756e664 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:16.664611 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef921ddd-1589-4dfb-b297-2bdab756e664 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:16.674718 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 485/970] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Jul 27 18:53:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:16.675984 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b39c1-f14a-48a2-961a-51e08d673157 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:16.676673 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c8df4-e4ca-465f-8e40-e09022ffeee3 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:16.676997 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c8df4-e4ca-465f-8e40-e09022ffeee3 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:16.677229 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c8df4-e4ca-465f-8e40-e09022ffeee3 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:16.679277 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 486/971] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:53:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:53:16.684056 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa2c41d-f737-4dd1-b754-7663f40d5d09 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:16.684339 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa2c41d-f737-4dd1-b754-7663f40d5d09 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:16.684610 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa2c41d-f737-4dd1-b754-7663f40d5d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:16.702028 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-8fa2c41d-f737-4dd1-b754-7663f40d5d09 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:53:16.703206 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-8fa2c41d-f737-4dd1-b754-7663f40d5d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:16.772030 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 487/972] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:53:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 18:53:16.782002 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b39c1-f14a-48a2-961a-51e08d673157 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:16.794485 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa2c41d-f737-4dd1-b754-7663f40d5d09 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:16.812111 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:16.821072 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852ce311-6047-49bd-8725-99c74dd7668f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:16.821689 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ce311-6047-49bd-8725-99c74dd7668f None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:16.821964 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ce311-6047-49bd-8725-99c74dd7668f None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:16.822227 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ce311-6047-49bd-8725-99c74dd7668f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:16.822990 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852ce311-6047-49bd-8725-99c74dd7668f None admin] RBAC: Adding query filter params (interface=admin, service_id=dd7911bc1f514ccbaebd10a5539bad2d, region_id=RegionOne) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:16.823300 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852ce311-6047-49bd-8725-99c74dd7668f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:16.824717 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852ce311-6047-49bd-8725-99c74dd7668f None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:16.835026 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 486/973] 10.222.0.20 () {56 vars in 1249 bytes} [Wed Jul 27 18:53:16 2022] GET /identity/v3/endpoints?service_id=dd7911bc1f514ccbaebd10a5539bad2d&interface=admin®ion_id=RegionOne => generated 193 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:16.837024 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852ce311-6047-49bd-8725-99c74dd7668f None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:16.870727 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:16.924359 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa2c41d-f737-4dd1-b754-7663f40d5d09 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:16.957672 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852ce311-6047-49bd-8725-99c74dd7668f None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:16.961103 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242724db-1a81-4ea6-baf8-ab77f3b57702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:16.961717 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242724db-1a81-4ea6-baf8-ab77f3b57702 None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:16.961996 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242724db-1a81-4ea6-baf8-ab77f3b57702 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:16.962270 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242724db-1a81-4ea6-baf8-ab77f3b57702 None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:16.962956 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242724db-1a81-4ea6-baf8-ab77f3b57702 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:16.964340 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242724db-1a81-4ea6-baf8-ab77f3b57702 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:16.980378 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 488/974] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Jul 27 18:53:16 2022] POST /identity/v3/services => generated 242 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:53:16.987767 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb03eb-cf07-4ea1-8385-a331299c611a None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:16.988188 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb03eb-cf07-4ea1-8385-a331299c611a None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:16.988569 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb03eb-cf07-4ea1-8385-a331299c611a None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:16.995072 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 489/975] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:53:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:53:16.996898 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd14b65-8f60-467c-8243-ef3a95958d3c None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:16.997229 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd14b65-8f60-467c-8243-ef3a95958d3c None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:16.997628 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd14b65-8f60-467c-8243-ef3a95958d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:17.003769 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c5f133-a9f3-4c67-abdb-26001de0fd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:17.004411 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5f133-a9f3-4c67-abdb-26001de0fd5a None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:17.004744 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5f133-a9f3-4c67-abdb-26001de0fd5a None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:17.005019 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5f133-a9f3-4c67-abdb-26001de0fd5a None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:17.005684 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c5f133-a9f3-4c67-abdb-26001de0fd5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:17.007850 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c5f133-a9f3-4c67-abdb-26001de0fd5a None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:17.014711 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 487/976] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Jul 27 18:53:16 2022] GET /identity/v3/services => generated 1727 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:53:17.020837 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-5fd14b65-8f60-467c-8243-ef3a95958d3c None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:53:17.022154 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-5fd14b65-8f60-467c-8243-ef3a95958d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:17.101818 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 490/977] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:53:16 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 18:53:17.125947 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c5f133-a9f3-4c67-abdb-26001de0fd5a None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:17.190862 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:17.255422 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c5f133-a9f3-4c67-abdb-26001de0fd5a None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:17.293988 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11455add-78bc-4cf6-a325-0d2c5dbfd00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:17.294628 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11455add-78bc-4cf6-a325-0d2c5dbfd00d None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:17.294908 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11455add-78bc-4cf6-a325-0d2c5dbfd00d None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:17.295180 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11455add-78bc-4cf6-a325-0d2c5dbfd00d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:17.305889 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11455add-78bc-4cf6-a325-0d2c5dbfd00d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:53:17.310788 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-11455add-78bc-4cf6-a325-0d2c5dbfd00d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 18:53:17.310788 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:17.310788 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:17.310788 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:17.310788 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:17.310788 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:17.310788 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:17.310788 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:17.310788 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:17.310788 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:17.310788 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:17.310788 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:17.310788 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:53:17.310788 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:53:17.310788 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:53:17.310788 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:53:17.311673 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:53:17.311673 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:53:17.311673 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:53:17.311673 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:53:17.311673 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:17.311673 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:17.311673 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:17.311673 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:17.311673 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:17.311673 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:17.311673 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:17.311673 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:17.311673 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:17.311673 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:17.311673 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:17.311673 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:17.317407 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:17.317407 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:17.317407 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:17.317407 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:17.317407 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:53:17.317407 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:53:17.317407 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:53:17.317407 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:53:17.317407 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:53:17.317407 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:53:17.317407 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 18:53:17.317407 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:53:17.317407 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 488/978] 10.222.0.20 () {56 vars in 1120 bytes} [Wed Jul 27 18:53:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:53:17.320222 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd14b65-8f60-467c-8243-ef3a95958d3c None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:17.370031 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:17.422328 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd14b65-8f60-467c-8243-ef3a95958d3c None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:17.455699 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5568cc-fd5d-47a7-b2ae-bfa245c5656e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:17.456334 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5568cc-fd5d-47a7-b2ae-bfa245c5656e None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:17.456613 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5568cc-fd5d-47a7-b2ae-bfa245c5656e None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:17.456886 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5568cc-fd5d-47a7-b2ae-bfa245c5656e None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:17.457602 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5568cc-fd5d-47a7-b2ae-bfa245c5656e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:17.457964 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5568cc-fd5d-47a7-b2ae-bfa245c5656e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:17.459350 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5568cc-fd5d-47a7-b2ae-bfa245c5656e None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:17.472024 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 491/979] 10.222.0.20 () {56 vars in 1115 bytes} [Wed Jul 27 18:53:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:17.473586 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11455add-78bc-4cf6-a325-0d2c5dbfd00d None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:17.585797 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11455add-78bc-4cf6-a325-0d2c5dbfd00d None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:17.603023 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:17.624096 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb574c-6529-4afa-b832-39d32e3e1c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:17.624727 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb574c-6529-4afa-b832-39d32e3e1c82 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:17.625003 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb574c-6529-4afa-b832-39d32e3e1c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:17.625271 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb574c-6529-4afa-b832-39d32e3e1c82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:17.635217 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fb574c-6529-4afa-b832-39d32e3e1c82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:17.636677 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fb574c-6529-4afa-b832-39d32e3e1c82 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:17.651526 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-34fb574c-6529-4afa-b832-39d32e3e1c82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:53:17.651526 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:17.651526 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:17.651526 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:17.651526 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:17.651526 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:17.651526 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:17.651526 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:17.651526 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:17.651526 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:17.651526 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:17.651526 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:17.651526 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:53:17.651526 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:53:17.651526 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:53:17.652526 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:53:17.652526 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:17.652526 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:17.652526 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:17.652526 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:17.652526 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:17.652526 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:17.652526 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:17.652526 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:17.652526 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:17.652526 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:17.652526 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:17.652526 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:17.652526 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:17.652526 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:17.652526 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:17.652526 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:17.658020 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:53:17.658020 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:53:17.658020 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:53:17.658020 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:53:17.658020 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 489/980] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:53:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:53:17.659747 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5568cc-fd5d-47a7-b2ae-bfa245c5656e None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:17.761381 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5568cc-fd5d-47a7-b2ae-bfa245c5656e None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:17.774634 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:17.797444 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f1e227-7727-4504-af66-ad60515b12e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:17.798048 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1e227-7727-4504-af66-ad60515b12e9 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:17.798326 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1e227-7727-4504-af66-ad60515b12e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:17.798593 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1e227-7727-4504-af66-ad60515b12e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:17.799268 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f1e227-7727-4504-af66-ad60515b12e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:17.799565 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f1e227-7727-4504-af66-ad60515b12e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:17.800944 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f1e227-7727-4504-af66-ad60515b12e9 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:17.812782 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 492/981] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:53:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:17.818256 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb574c-6529-4afa-b832-39d32e3e1c82 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:17.918114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb574c-6529-4afa-b832-39d32e3e1c82 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:17.949639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e7169-fd46-4f59-9897-a7683c57c9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:17.950257 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e7169-fd46-4f59-9897-a7683c57c9e9 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:17.950538 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e7169-fd46-4f59-9897-a7683c57c9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:17.950810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e7169-fd46-4f59-9897-a7683c57c9e9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:17.958886 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6e7169-fd46-4f59-9897-a7683c57c9e9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:17.960856 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6e7169-fd46-4f59-9897-a7683c57c9e9 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:17.971774 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-db6e7169-fd46-4f59-9897-a7683c57c9e9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 18:53:17.971774 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:17.971774 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:17.971774 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:17.971774 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:17.971774 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:17.971774 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:17.971774 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:17.971774 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:17.971774 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:17.971774 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:17.971774 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:17.971774 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:53:17.971774 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:53:17.971774 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:53:17.971774 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:53:17.972667 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:17.972667 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:17.972667 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:53:17.972667 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:53:17.972667 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:53:17.972667 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:53:17.972667 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:17.972667 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:17.972667 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:17.972667 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:17.972667 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:17.972667 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:17.972667 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:17.972667 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:17.972667 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:17.972667 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:17.972667 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:17.972667 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:17.978795 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:17.978795 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:17.978795 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:53:17.978795 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:53:17.978795 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:53:17.978795 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:53:17.978795 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:53:17.978795 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:53:17.978795 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 18:53:17.978795 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:53:17.978795 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 490/982] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Jul 27 18:53:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:53:17.981015 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f1e227-7727-4504-af66-ad60515b12e9 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:18.079599 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f1e227-7727-4504-af66-ad60515b12e9 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:18.115162 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60955331-df6a-48f8-b6ba-f0680ebe4572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:18.115843 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60955331-df6a-48f8-b6ba-f0680ebe4572 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:18.116109 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60955331-df6a-48f8-b6ba-f0680ebe4572 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:18.116385 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60955331-df6a-48f8-b6ba-f0680ebe4572 None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:18.117177 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60955331-df6a-48f8-b6ba-f0680ebe4572 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:18.117488 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60955331-df6a-48f8-b6ba-f0680ebe4572 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:18.118910 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60955331-df6a-48f8-b6ba-f0680ebe4572 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:18.143024 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 493/983] 10.222.0.20 () {56 vars in 1149 bytes} [Wed Jul 27 18:53:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:18.144770 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e7169-fd46-4f59-9897-a7683c57c9e9 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:18.175334 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:18.249891 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e7169-fd46-4f59-9897-a7683c57c9e9 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:18.282879 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b439c27-4b7d-4e05-976c-f1e346f70deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:18.283483 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b439c27-4b7d-4e05-976c-f1e346f70deb None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:18.283853 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b439c27-4b7d-4e05-976c-f1e346f70deb None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:18.284124 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b439c27-4b7d-4e05-976c-f1e346f70deb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:18.350330 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b439c27-4b7d-4e05-976c-f1e346f70deb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:18.351706 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b439c27-4b7d-4e05-976c-f1e346f70deb None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:18.377533 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:18.455635 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 491/984] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 27 18:53:18 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 18:53:18.456977 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60955331-df6a-48f8-b6ba-f0680ebe4572 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:18.489150 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:18.563130 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60955331-df6a-48f8-b6ba-f0680ebe4572 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:18.614478 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6912fd-690a-4a26-b568-ec223b406bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:18.615807 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6912fd-690a-4a26-b568-ec223b406bc8 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:18.616224 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6912fd-690a-4a26-b568-ec223b406bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:18.616644 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6912fd-690a-4a26-b568-ec223b406bc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:18.631886 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6912fd-690a-4a26-b568-ec223b406bc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:18.633864 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6912fd-690a-4a26-b568-ec223b406bc8 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:18.652515 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-5c6912fd-690a-4a26-b568-ec223b406bc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:53:18.652515 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:18.652515 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:18.652515 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:18.652515 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:18.652515 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:18.652515 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:18.652515 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:18.652515 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:18.652515 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:18.652515 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:18.652515 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:18.652515 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:53:18.652515 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:53:18.652515 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:53:18.653445 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:53:18.653445 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:18.653445 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:18.653445 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:18.653445 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:18.653445 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:18.653445 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:18.653445 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:18.653445 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:18.653445 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:18.653445 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:18.653445 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:18.653445 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:18.653445 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:18.653445 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:18.653445 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:18.653445 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:18.654333 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:53:18.654333 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:53:18.654333 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:53:18.654333 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:18.656032 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 494/985] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:53:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:53:18.659286 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b439c27-4b7d-4e05-976c-f1e346f70deb None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:18.761719 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b439c27-4b7d-4e05-976c-f1e346f70deb None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:18.787597 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:18.797034 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ad4cf-2172-4760-8cb6-45337c7d58a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:18.797688 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ad4cf-2172-4760-8cb6-45337c7d58a2 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:18.797987 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ad4cf-2172-4760-8cb6-45337c7d58a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:18.798266 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ad4cf-2172-4760-8cb6-45337c7d58a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:18.798993 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553ad4cf-2172-4760-8cb6-45337c7d58a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:18.799301 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553ad4cf-2172-4760-8cb6-45337c7d58a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:18.800701 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553ad4cf-2172-4760-8cb6-45337c7d58a2 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:18.817052 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 492/986] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:53:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:18.819280 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6912fd-690a-4a26-b568-ec223b406bc8 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:18.903127 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:18.924100 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6912fd-690a-4a26-b568-ec223b406bc8 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:18.958587 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b6a59-a1d3-4ac7-badb-942bd8302123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:18.959317 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b6a59-a1d3-4ac7-badb-942bd8302123 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:18.959595 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b6a59-a1d3-4ac7-badb-942bd8302123 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:18.959937 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b6a59-a1d3-4ac7-badb-942bd8302123 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:18.966778 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7b6a59-a1d3-4ac7-badb-942bd8302123 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:18.968249 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7b6a59-a1d3-4ac7-badb-942bd8302123 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:18.980045 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-8f7b6a59-a1d3-4ac7-badb-942bd8302123 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:53:18.980045 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:18.980045 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:18.980045 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:18.980045 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:18.980045 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:18.980045 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:18.980045 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:18.980045 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:18.980045 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:18.980045 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:18.980045 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:18.980045 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:53:18.980045 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:53:18.980045 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:53:18.980936 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:53:18.980936 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:18.980936 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:18.980936 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:18.980936 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:18.980936 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:18.980936 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:18.980936 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:18.980936 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:18.980936 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:18.980936 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:18.980936 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:18.980936 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:18.980936 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:18.980936 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:18.980936 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:18.980936 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:18.982003 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:53:18.982003 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:53:18.982003 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:53:18.982003 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:53:18.982003 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:53:18.982003 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:53:18.982003 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:53:18.982003 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:18.984002 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 495/987] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 27 18:53:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:53:18.987287 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ad4cf-2172-4760-8cb6-45337c7d58a2 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:19.056250 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6dfcd-aad2-4924-992c-612d1b6b3c61 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:19.056559 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6dfcd-aad2-4924-992c-612d1b6b3c61 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:19.056808 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6dfcd-aad2-4924-992c-612d1b6b3c61 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:19.058373 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 496/988] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:53:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:53:19.059375 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8863e3f-7c94-471e-b8b4-5fd1f52eeaf4 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:19.059662 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8863e3f-7c94-471e-b8b4-5fd1f52eeaf4 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:19.059965 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8863e3f-7c94-471e-b8b4-5fd1f52eeaf4 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:19.061132 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 497/989] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:53:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:53:19.063302 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd3469-76d9-4127-810d-328d091bf75b None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:19.063580 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd3469-76d9-4127-810d-328d091bf75b None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:19.063897 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd3469-76d9-4127-810d-328d091bf75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:19.081713 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-04fd3469-76d9-4127-810d-328d091bf75b None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:53:19.082908 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-04fd3469-76d9-4127-810d-328d091bf75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:19.094034 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ad4cf-2172-4760-8cb6-45337c7d58a2 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:19.127223 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186135c-f6db-4739-b558-b275daca9eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:19.127864 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186135c-f6db-4739-b558-b275daca9eee None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:19.128143 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186135c-f6db-4739-b558-b275daca9eee None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:19.128416 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186135c-f6db-4739-b558-b275daca9eee None admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:19.129158 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d186135c-f6db-4739-b558-b275daca9eee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:19.129462 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d186135c-f6db-4739-b558-b275daca9eee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:19.130908 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d186135c-f6db-4739-b558-b275daca9eee None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:19.142371 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 493/990] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 27 18:53:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:19.143507 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077f98c-b852-412d-b945-276d1a5d2ce6 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:19.143817 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077f98c-b852-412d-b945-276d1a5d2ce6 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:19.144097 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077f98c-b852-412d-b945-276d1a5d2ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:19.149618 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 498/991] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:53:19 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:53:19.151059 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd3469-76d9-4127-810d-328d091bf75b None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:19.163639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-0077f98c-b852-412d-b945-276d1a5d2ce6 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:53:19.164834 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-0077f98c-b852-412d-b945-276d1a5d2ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:19.208861 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:19.221036 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:19.233851 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 494/992] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:53:19 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:53:19.235467 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0077f98c-b852-412d-b945-276d1a5d2ce6 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:19.252392 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd3469-76d9-4127-810d-328d091bf75b None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:19.286117 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32889ea3-c4b9-4588-ad96-c1c3a5b947be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:19.286723 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32889ea3-c4b9-4588-ad96-c1c3a5b947be None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:19.286994 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32889ea3-c4b9-4588-ad96-c1c3a5b947be None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:19.287907 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32889ea3-c4b9-4588-ad96-c1c3a5b947be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:19.288685 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32889ea3-c4b9-4588-ad96-c1c3a5b947be None admin] RBAC: Adding query filter params (role.id=f388f0bd9c714f86a7657d98f844d701, scope.project.id=31f027c53398443eb548eaf3f24523e0, user.id=a277ddae777442869114c4c5deff7d7e) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:19.288989 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32889ea3-c4b9-4588-ad96-c1c3a5b947be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:19.290398 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32889ea3-c4b9-4588-ad96-c1c3a5b947be None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:19.296393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 499/993] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 27 18:53:19 2022] GET /identity/v3/role_assignments?user.id=a277ddae777442869114c4c5deff7d7e&scope.project.id=31f027c53398443eb548eaf3f24523e0&role.id=f388f0bd9c714f86a7657d98f844d701 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:19.297153 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32889ea3-c4b9-4588-ad96-c1c3a5b947be None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:19.348860 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0077f98c-b852-412d-b945-276d1a5d2ce6 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:19.393467 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b7f769-7468-4324-82db-759f480a97d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:19.394527 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7f769-7468-4324-82db-759f480a97d8 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:19.394812 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7f769-7468-4324-82db-759f480a97d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:19.395079 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7f769-7468-4324-82db-759f480a97d8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:19.395755 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b7f769-7468-4324-82db-759f480a97d8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:19.397651 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b7f769-7468-4324-82db-759f480a97d8 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:19.407426 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-d3b7f769-7468-4324-82db-759f480a97d8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 18:53:19.407426 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:19.407426 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:53:19.407426 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:53:19.407426 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:53:19.407426 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:53:19.407426 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:53:19.407426 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:53:19.407426 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 18:53:19.407426 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:53:19.407426 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:53:19.407426 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:53:19.407426 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:19.407426 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:19.407426 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:19.407426 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:19.407426 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:19.412198 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:19.412198 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:19.412198 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:19.412198 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:19.412198 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:19.412198 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:19.412198 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:53:19.412198 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:53:19.412198 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:53:19.412198 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:53:19.412198 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:19.412198 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:19.412198 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:19.412198 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:19.412198 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:19.412198 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:19.413787 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:19.413787 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:19.413787 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:19.413787 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:19.413787 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:19.413787 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:19.413787 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:19.413787 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:19.413787 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:19.413787 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:19.413787 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:53:19.413787 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:53:19.413787 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 18:53:19.413787 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:53:19.413787 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 495/994] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Jul 27 18:53:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:53:19.415821 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b7f769-7468-4324-82db-759f480a97d8 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:19.421835 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32889ea3-c4b9-4588-ad96-c1c3a5b947be None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:19.464128 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ba853-6eb2-4f6b-bfe2-551313025539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:19.465126 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ba853-6eb2-4f6b-bfe2-551313025539 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:19.465412 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ba853-6eb2-4f6b-bfe2-551313025539 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:19.465684 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ba853-6eb2-4f6b-bfe2-551313025539 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:19.466110 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:19.466620 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445ba853-6eb2-4f6b-bfe2-551313025539 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:19.468792 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445ba853-6eb2-4f6b-bfe2-551313025539 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:19.472849 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:19.481698 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-445ba853-6eb2-4f6b-bfe2-551313025539 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 18:53:19.481698 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:19.481698 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:53:19.481698 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:53:19.481698 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:53:19.481698 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:53:19.481698 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:53:19.481698 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:53:19.481698 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 18:53:19.481698 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:19.481698 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:53:19.481698 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:19.481698 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:19.481698 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:19.481698 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:19.481698 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:19.481698 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:19.482791 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:19.482791 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:19.482791 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:19.482791 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:19.482791 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:19.482791 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:19.482791 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:53:19.482791 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:53:19.482791 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:53:19.482791 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:53:19.482791 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:19.482791 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:19.482791 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:19.482791 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:19.482791 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:19.482791 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:19.483860 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:19.483860 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:19.483860 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:19.483860 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:19.483860 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:19.483860 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:19.483860 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:19.483860 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:19.483860 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:19.483860 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:19.483860 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:53:19.483860 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:53:19.483860 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 18:53:19.483860 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:19.486438 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 500/995] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 27 18:53:19 2022] GET /identity/v3/services/compute => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:53:19.491952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ba853-6eb2-4f6b-bfe2-551313025539 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:19.538060 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b7f769-7468-4324-82db-759f480a97d8 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:19.573219 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1994426-4ab8-4c08-a9e3-46a0605b18f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:19.573926 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1994426-4ab8-4c08-a9e3-46a0605b18f7 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:19.574273 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1994426-4ab8-4c08-a9e3-46a0605b18f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:19.574605 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1994426-4ab8-4c08-a9e3-46a0605b18f7 None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:19.575342 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1994426-4ab8-4c08-a9e3-46a0605b18f7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:19.575724 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1994426-4ab8-4c08-a9e3-46a0605b18f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:19.577142 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1994426-4ab8-4c08-a9e3-46a0605b18f7 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:19.582149 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 496/996] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Jul 27 18:53:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:19.588238 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1994426-4ab8-4c08-a9e3-46a0605b18f7 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:19.601720 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ba853-6eb2-4f6b-bfe2-551313025539 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:19.640125 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c24d1e-7bf6-44cb-97cc-b0d0f1799777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:19.640986 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c24d1e-7bf6-44cb-97cc-b0d0f1799777 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:19.641454 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c24d1e-7bf6-44cb-97cc-b0d0f1799777 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:19.641733 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c24d1e-7bf6-44cb-97cc-b0d0f1799777 None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:19.642419 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c24d1e-7bf6-44cb-97cc-b0d0f1799777 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:19.642728 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c24d1e-7bf6-44cb-97cc-b0d0f1799777 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:19.644117 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c24d1e-7bf6-44cb-97cc-b0d0f1799777 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:19.649671 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 501/997] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Jul 27 18:53:19 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:19.655146 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c24d1e-7bf6-44cb-97cc-b0d0f1799777 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:19.703649 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1994426-4ab8-4c08-a9e3-46a0605b18f7 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:19.711435 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:19.720738 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:19.740812 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e392bfb2-80be-4d0b-a675-a2f2b832dd3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:19.741431 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392bfb2-80be-4d0b-a675-a2f2b832dd3d None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:19.741712 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392bfb2-80be-4d0b-a675-a2f2b832dd3d None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:19.741983 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392bfb2-80be-4d0b-a675-a2f2b832dd3d None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:19.742646 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e392bfb2-80be-4d0b-a675-a2f2b832dd3d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:19.742954 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e392bfb2-80be-4d0b-a675-a2f2b832dd3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:19.744339 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e392bfb2-80be-4d0b-a675-a2f2b832dd3d None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:19.753873 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 497/998] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Jul 27 18:53:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:53:19.754842 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e392bfb2-80be-4d0b-a675-a2f2b832dd3d None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:19.767535 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c24d1e-7bf6-44cb-97cc-b0d0f1799777 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:19.803512 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c5404-4a09-4ca6-9e06-0cdbd456f254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:19.804213 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c5404-4a09-4ca6-9e06-0cdbd456f254 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:19.804430 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c5404-4a09-4ca6-9e06-0cdbd456f254 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:19.804696 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c5404-4a09-4ca6-9e06-0cdbd456f254 None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:19.805367 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c5404-4a09-4ca6-9e06-0cdbd456f254 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:19.805669 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c5404-4a09-4ca6-9e06-0cdbd456f254 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:19.806992 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c5404-4a09-4ca6-9e06-0cdbd456f254 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:19.816788 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 502/999] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Jul 27 18:53:19 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:53:19.817788 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c5404-4a09-4ca6-9e06-0cdbd456f254 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:19.866565 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e392bfb2-80be-4d0b-a675-a2f2b832dd3d None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:19.903514 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36504bf0-c3cd-4b5c-b7c0-6c7ec9c540a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:19.904159 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36504bf0-c3cd-4b5c-b7c0-6c7ec9c540a6 None admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:19.904441 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36504bf0-c3cd-4b5c-b7c0-6c7ec9c540a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:19.904713 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36504bf0-c3cd-4b5c-b7c0-6c7ec9c540a6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:19.905414 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36504bf0-c3cd-4b5c-b7c0-6c7ec9c540a6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:19.906754 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36504bf0-c3cd-4b5c-b7c0-6c7ec9c540a6 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:19.931730 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c5404-4a09-4ca6-9e06-0cdbd456f254 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:19.931989 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 498/1000] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Jul 27 18:53:19 2022] POST /identity/v3/endpoints => generated 325 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:53:19.972945 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:19.996931 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5a808-6df1-4459-8727-3ade4d66a9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:19.997752 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5a808-6df1-4459-8727-3ade4d66a9a7 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:19.998104 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5a808-6df1-4459-8727-3ade4d66a9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:19.998443 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5a808-6df1-4459-8727-3ade4d66a9a7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:19.999669 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b5a808-6df1-4459-8727-3ade4d66a9a7 None admin] RBAC: Adding query filter params (interface=public, service_id=9b6c0ed6894d4ee9a925946c08b177b2, region_id=RegionOne) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:20.000257 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b5a808-6df1-4459-8727-3ade4d66a9a7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:20.002571 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b5a808-6df1-4459-8727-3ade4d66a9a7 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:20.010616 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 503/1001] 10.222.0.20 () {56 vars in 1251 bytes} [Wed Jul 27 18:53:19 2022] GET /identity/v3/endpoints?service_id=9b6c0ed6894d4ee9a925946c08b177b2&interface=public®ion_id=RegionOne => generated 194 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:20.018279 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36504bf0-c3cd-4b5c-b7c0-6c7ec9c540a6 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:20.055782 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:20.131720 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36504bf0-c3cd-4b5c-b7c0-6c7ec9c540a6 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:20.164449 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9743f77a-4c1b-42f9-b83c-2964511fc027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:20.165114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743f77a-4c1b-42f9-b83c-2964511fc027 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:20.165392 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743f77a-4c1b-42f9-b83c-2964511fc027 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:20.165660 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743f77a-4c1b-42f9-b83c-2964511fc027 None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:20.166301 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9743f77a-4c1b-42f9-b83c-2964511fc027 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:20.167672 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9743f77a-4c1b-42f9-b83c-2964511fc027 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:20.173921 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 499/1002] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Jul 27 18:53:20 2022] GET /identity/v3/services => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:53:21.320313 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816632c-0568-4921-ad67-fd9d2bde3d94 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:21.320833 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816632c-0568-4921-ad67-fd9d2bde3d94 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:21.320911 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816632c-0568-4921-ad67-fd9d2bde3d94 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:21.322233 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 504/1003] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:53:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:53:21.327340 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb82503-4da8-435a-9d86-8634d6d022dc None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:21.327850 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb82503-4da8-435a-9d86-8634d6d022dc None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:21.327934 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb82503-4da8-435a-9d86-8634d6d022dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:21.345466 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-5cb82503-4da8-435a-9d86-8634d6d022dc None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:53:21.346625 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-5cb82503-4da8-435a-9d86-8634d6d022dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:21.416902 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 500/1004] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:53:21 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:53:21.438407 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d816632c-0568-4921-ad67-fd9d2bde3d94 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:21.547455 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d816632c-0568-4921-ad67-fd9d2bde3d94 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:21.581271 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff540a-2307-497d-ae29-8f7869cc1222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:21.581825 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff540a-2307-497d-ae29-8f7869cc1222 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:21.582104 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff540a-2307-497d-ae29-8f7869cc1222 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:21.582373 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff540a-2307-497d-ae29-8f7869cc1222 None admin] PATH_INFO: `/v3/services/image` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:21.582992 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff540a-2307-497d-ae29-8f7869cc1222 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:21.584881 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff540a-2307-497d-ae29-8f7869cc1222 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:21.593855 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-b4ff540a-2307-497d-ae29-8f7869cc1222 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 18:53:21.593855 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:21.593855 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:53:21.593855 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:53:21.593855 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:53:21.593855 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:53:21.593855 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:53:21.593855 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:53:21.593855 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 18:53:21.593855 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:21.593855 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:53:21.593855 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:21.593855 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:21.593855 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:21.593855 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:21.593855 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:21.593855 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:21.594805 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:21.594805 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:21.594805 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:21.594805 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:21.594805 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:21.594805 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:21.594805 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:53:21.594805 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:53:21.594805 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:53:21.594805 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:53:21.594805 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:21.594805 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:21.594805 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:21.594805 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:21.594805 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:21.594805 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:21.601121 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:21.601121 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:21.601121 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:21.601121 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:21.601121 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:21.601121 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:21.601121 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:21.601121 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:21.601121 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:21.601121 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:21.601121 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:53:21.601121 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:53:21.601121 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 18:53:21.601121 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:21.601121 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 505/1005] 10.222.0.20 () {56 vars in 1105 bytes} [Wed Jul 27 18:53:21 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:53:21.603664 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb82503-4da8-435a-9d86-8634d6d022dc None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:21.629081 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:21.707103 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb82503-4da8-435a-9d86-8634d6d022dc None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:21.741878 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d950935-7b5b-4809-b261-339b3d544b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:21.742490 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d950935-7b5b-4809-b261-339b3d544b7f None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:21.742769 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d950935-7b5b-4809-b261-339b3d544b7f None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:21.743040 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d950935-7b5b-4809-b261-339b3d544b7f None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:21.743742 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d950935-7b5b-4809-b261-339b3d544b7f None admin] RBAC: Adding query filter params (name=image) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:21.744051 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d950935-7b5b-4809-b261-339b3d544b7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:21.745404 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d950935-7b5b-4809-b261-339b3d544b7f None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:21.754829 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 501/1006] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:53:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:53:21.756475 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff540a-2307-497d-ae29-8f7869cc1222 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:21.812639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:21.862799 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff540a-2307-497d-ae29-8f7869cc1222 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:21.897813 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89910f-375a-41fd-8852-30ba32fcc300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:21.898427 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89910f-375a-41fd-8852-30ba32fcc300 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:21.898711 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89910f-375a-41fd-8852-30ba32fcc300 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:21.898988 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89910f-375a-41fd-8852-30ba32fcc300 None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:21.899663 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e89910f-375a-41fd-8852-30ba32fcc300 None admin] RBAC: Adding query filter params (type=image) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:21.900004 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e89910f-375a-41fd-8852-30ba32fcc300 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:21.901355 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e89910f-375a-41fd-8852-30ba32fcc300 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:21.906292 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 506/1007] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:53:21 2022] GET /identity/v3/services?type=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:21.995416 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9fbf6-4830-4e1b-bfb9-89313fd63f2e None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:21.995766 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9fbf6-4830-4e1b-bfb9-89313fd63f2e None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:21.996000 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9fbf6-4830-4e1b-bfb9-89313fd63f2e None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:21.997525 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 502/1008] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:53:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:53:22.003025 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6e3bc-a5f3-40e9-9468-787fa477784b None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:22.003312 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6e3bc-a5f3-40e9-9468-787fa477784b None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:22.003588 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6e3bc-a5f3-40e9-9468-787fa477784b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:22.023574 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-a9d6e3bc-a5f3-40e9-9468-787fa477784b None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:53:22.024795 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a9d6e3bc-a5f3-40e9-9468-787fa477784b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:22.098438 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 507/1009] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:53:22 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:53:22.120739 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc9fbf6-4830-4e1b-bfb9-89313fd63f2e None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:22.153731 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c49b8-d2cf-45b7-8b0e-13d909be9c57 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:22.154108 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c49b8-d2cf-45b7-8b0e-13d909be9c57 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:22.154279 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c49b8-d2cf-45b7-8b0e-13d909be9c57 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:22.155768 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 508/1010] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:53:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:53:22.160447 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6f307-6763-4369-9442-f11624be01f9 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:22.160733 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6f307-6763-4369-9442-f11624be01f9 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:22.161008 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6f307-6763-4369-9442-f11624be01f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:22.182684 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-14e6f307-6763-4369-9442-f11624be01f9 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:53:22.183876 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-14e6f307-6763-4369-9442-f11624be01f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:22.213240 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:22.229205 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc9fbf6-4830-4e1b-bfb9-89313fd63f2e None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:22.234140 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:22.264950 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 509/1011] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:53:22 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:53:22.265132 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59adabbc-71e4-41ce-8b5e-34f5789f754d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:22.265481 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59adabbc-71e4-41ce-8b5e-34f5789f754d None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:22.265798 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59adabbc-71e4-41ce-8b5e-34f5789f754d None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:22.266020 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59adabbc-71e4-41ce-8b5e-34f5789f754d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:22.267158 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59adabbc-71e4-41ce-8b5e-34f5789f754d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:22.268592 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59adabbc-71e4-41ce-8b5e-34f5789f754d None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:22.275089 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 503/1012] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:53:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:22.275820 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e6f307-6763-4369-9442-f11624be01f9 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:22.286334 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59adabbc-71e4-41ce-8b5e-34f5789f754d None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:22.378582 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e6f307-6763-4369-9442-f11624be01f9 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:22.397614 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59adabbc-71e4-41ce-8b5e-34f5789f754d None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:22.412803 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85042a23-879e-483e-9e18-0683cf698b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:22.413561 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85042a23-879e-483e-9e18-0683cf698b3c None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:22.413847 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85042a23-879e-483e-9e18-0683cf698b3c None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:22.414167 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85042a23-879e-483e-9e18-0683cf698b3c None admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:22.414970 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85042a23-879e-483e-9e18-0683cf698b3c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:22.416608 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85042a23-879e-483e-9e18-0683cf698b3c None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:22.434899 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac0b70-93e9-44c1-acb4-4d40efbbd482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:22.435994 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac0b70-93e9-44c1-acb4-4d40efbbd482 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:22.436247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac0b70-93e9-44c1-acb4-4d40efbbd482 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:22.436513 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac0b70-93e9-44c1-acb4-4d40efbbd482 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:22.437102 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ac0b70-93e9-44c1-acb4-4d40efbbd482 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:22.438444 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ac0b70-93e9-44c1-acb4-4d40efbbd482 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:22.447055 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 510/1013] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Jul 27 18:53:22 2022] POST /identity/v3/projects => generated 311 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:53:22.448362 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-79ac0b70-93e9-44c1-acb4-4d40efbbd482 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 18:53:22.448362 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:22.448362 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:53:22.448362 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:53:22.448362 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:53:22.448362 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:53:22.448362 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:53:22.448362 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:53:22.448362 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 18:53:22.448362 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:53:22.448362 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:53:22.448362 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:53:22.448362 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:22.448362 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:22.448362 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:22.448362 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:22.448362 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:22.449424 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:22.449424 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:22.449424 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:22.449424 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:22.449424 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:22.449424 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:22.449424 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:53:22.449424 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:53:22.449424 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:53:22.449424 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:53:22.449424 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:22.449424 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:22.449424 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:22.449424 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:22.449424 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:22.449424 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:22.450247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:22.450247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:22.450247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:22.450247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:22.450247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:22.450247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:22.450247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:22.450247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:22.450247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:22.450247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:22.450247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:53:22.450247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:53:22.450247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 18:53:22.450247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:53:22.451641 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 504/1014] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 27 18:53:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:53:22.455652 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85042a23-879e-483e-9e18-0683cf698b3c None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:22.495112 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:22.582998 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85042a23-879e-483e-9e18-0683cf698b3c None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:22.620164 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b561c31-9544-4a3d-8f92-9418955b5811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:22.620918 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b561c31-9544-4a3d-8f92-9418955b5811 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:22.621296 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b561c31-9544-4a3d-8f92-9418955b5811 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:22.621662 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b561c31-9544-4a3d-8f92-9418955b5811 None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:22.622489 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b561c31-9544-4a3d-8f92-9418955b5811 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:22.622833 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b561c31-9544-4a3d-8f92-9418955b5811 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:22.624303 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b561c31-9544-4a3d-8f92-9418955b5811 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:22.629556 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 511/1015] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Jul 27 18:53:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:53:22.635977 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac0b70-93e9-44c1-acb4-4d40efbbd482 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:22.659663 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:22.739362 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac0b70-93e9-44c1-acb4-4d40efbbd482 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:22.772250 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086fd5f3-94a0-4a77-831c-77add884f22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:22.772859 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086fd5f3-94a0-4a77-831c-77add884f22a None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:22.773137 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086fd5f3-94a0-4a77-831c-77add884f22a None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:22.773409 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086fd5f3-94a0-4a77-831c-77add884f22a None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:22.774081 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086fd5f3-94a0-4a77-831c-77add884f22a None admin] RBAC: Adding query filter params (type=compute) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:22.774384 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086fd5f3-94a0-4a77-831c-77add884f22a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:22.775768 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086fd5f3-94a0-4a77-831c-77add884f22a None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:22.780654 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 505/1016] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Jul 27 18:53:22 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:53:22.786327 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b561c31-9544-4a3d-8f92-9418955b5811 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:22.881976 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:22.891794 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b561c31-9544-4a3d-8f92-9418955b5811 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:22.925844 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b651a-2896-4fc4-a2e9-a52e4338c9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:22.926548 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b651a-2896-4fc4-a2e9-a52e4338c9a8 None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:22.926904 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b651a-2896-4fc4-a2e9-a52e4338c9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:22.927246 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b651a-2896-4fc4-a2e9-a52e4338c9a8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:22.928665 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687b651a-2896-4fc4-a2e9-a52e4338c9a8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:22.930078 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687b651a-2896-4fc4-a2e9-a52e4338c9a8 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:22.952007 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 512/1017] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Jul 27 18:53:22 2022] POST /identity/v3/endpoints => generated 334 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:53:24.005962 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333cc735-860d-4c09-af52-c6ce81e68531 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:24.006525 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333cc735-860d-4c09-af52-c6ce81e68531 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:24.006525 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333cc735-860d-4c09-af52-c6ce81e68531 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:24.011483 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 506/1018] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:53:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:53:24.013197 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e806c2-43e5-4e5f-9c20-869e886b4cb7 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:24.013603 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e806c2-43e5-4e5f-9c20-869e886b4cb7 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:24.013800 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e806c2-43e5-4e5f-9c20-869e886b4cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:24.032383 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-f7e806c2-43e5-4e5f-9c20-869e886b4cb7 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:53:24.033587 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-f7e806c2-43e5-4e5f-9c20-869e886b4cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:24.109309 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 513/1019] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:53:24 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:53:24.132516 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333cc735-860d-4c09-af52-c6ce81e68531 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:24.220845 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:24.238775 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333cc735-860d-4c09-af52-c6ce81e68531 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:24.275166 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789956f9-465b-4908-834d-867cf3bfdec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:24.275727 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789956f9-465b-4908-834d-867cf3bfdec3 None admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:24.276016 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789956f9-465b-4908-834d-867cf3bfdec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:24.276289 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789956f9-465b-4908-834d-867cf3bfdec3 None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:24.276981 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789956f9-465b-4908-834d-867cf3bfdec3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:24.278345 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789956f9-465b-4908-834d-867cf3bfdec3 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:24.299725 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 507/1020] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Jul 27 18:53:24 2022] POST /identity/v3/services => generated 242 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:53:24.498237 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4fc29c-ec72-49a9-8f04-0c79d863f7a2 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:24.498582 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4fc29c-ec72-49a9-8f04-0c79d863f7a2 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:24.498782 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4fc29c-ec72-49a9-8f04-0c79d863f7a2 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:24.500300 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 514/1021] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:53:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:53:24.505299 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67825c8-3e50-4346-af94-2a071e1045f5 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:24.505666 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67825c8-3e50-4346-af94-2a071e1045f5 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:24.506449 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67825c8-3e50-4346-af94-2a071e1045f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:24.527148 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-a67825c8-3e50-4346-af94-2a071e1045f5 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:53:24.528679 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-a67825c8-3e50-4346-af94-2a071e1045f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:24.604367 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 508/1022] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:53:24 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 18:53:24.630259 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4fc29c-ec72-49a9-8f04-0c79d863f7a2 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:24.706407 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:24.734686 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4fc29c-ec72-49a9-8f04-0c79d863f7a2 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:24.769594 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617287dd-33ec-4e73-bace-2637989607a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:24.770233 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617287dd-33ec-4e73-bace-2637989607a2 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:24.770509 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617287dd-33ec-4e73-bace-2637989607a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:24.770777 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617287dd-33ec-4e73-bace-2637989607a2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:24.771986 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617287dd-33ec-4e73-bace-2637989607a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:24.773393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617287dd-33ec-4e73-bace-2637989607a2 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:24.774995 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 515/1023] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:53:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:24.780983 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67825c8-3e50-4346-af94-2a071e1045f5 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:24.847565 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:24.880477 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67825c8-3e50-4346-af94-2a071e1045f5 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:24.913967 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5e5d88-75cf-49c9-97a3-e17cdbea66fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:24.914575 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e5d88-75cf-49c9-97a3-e17cdbea66fa None admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:24.914850 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e5d88-75cf-49c9-97a3-e17cdbea66fa None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:24.915116 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e5d88-75cf-49c9-97a3-e17cdbea66fa None admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:24.915815 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5e5d88-75cf-49c9-97a3-e17cdbea66fa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:24.917234 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5e5d88-75cf-49c9-97a3-e17cdbea66fa None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:24.939491 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 509/1024] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Jul 27 18:53:24 2022] POST /identity/v3/users => generated 285 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:53:25.060657 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4e3c8-5c8b-479a-9d24-5a61a797204a None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:25.061183 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4e3c8-5c8b-479a-9d24-5a61a797204a None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:25.061183 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4e3c8-5c8b-479a-9d24-5a61a797204a None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:25.062702 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 516/1025] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:53:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:53:25.068214 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0806b0-107e-4adb-8f0e-7c8c696445ea None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:25.068702 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0806b0-107e-4adb-8f0e-7c8c696445ea None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:25.068775 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0806b0-107e-4adb-8f0e-7c8c696445ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:25.087172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-cb0806b0-107e-4adb-8f0e-7c8c696445ea None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:53:25.088449 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-cb0806b0-107e-4adb-8f0e-7c8c696445ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:25.158367 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 510/1026] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:53:25 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:53:25.182561 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4e3c8-5c8b-479a-9d24-5a61a797204a None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:25.295915 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4e3c8-5c8b-479a-9d24-5a61a797204a None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:25.330395 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0564fdc-e43e-4188-b93c-9a6e5d9385fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:25.330948 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0564fdc-e43e-4188-b93c-9a6e5d9385fa None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:25.331226 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0564fdc-e43e-4188-b93c-9a6e5d9385fa None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:25.331497 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0564fdc-e43e-4188-b93c-9a6e5d9385fa None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:25.342198 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0564fdc-e43e-4188-b93c-9a6e5d9385fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:53:25.347069 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-a0564fdc-e43e-4188-b93c-9a6e5d9385fa None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 18:53:25.347069 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:25.347069 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:25.347069 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:25.347069 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:25.347069 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:25.347069 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:25.347069 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:25.347069 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:25.347069 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:25.347069 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:25.347069 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:25.347069 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:53:25.347069 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:53:25.347069 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:53:25.347069 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:53:25.348213 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:53:25.348213 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:53:25.348213 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:53:25.348213 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:53:25.348213 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:25.348213 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:25.348213 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:25.348213 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:25.348213 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:25.348213 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:25.348213 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:25.348213 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:25.348213 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:25.348213 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:25.348213 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:25.348213 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:25.349073 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:25.349073 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:25.349073 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:25.349073 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:25.349073 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:53:25.349073 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:53:25.349073 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:53:25.349073 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:53:25.349073 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:53:25.349073 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:53:25.349073 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 18:53:25.349073 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:25.349073 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 517/1027] 10.222.0.20 () {56 vars in 1120 bytes} [Wed Jul 27 18:53:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:53:25.356609 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0806b0-107e-4adb-8f0e-7c8c696445ea None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:25.414313 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:25.463073 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0806b0-107e-4adb-8f0e-7c8c696445ea None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:25.496947 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc7209-f7db-49d2-9390-66cc835f2819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:25.497562 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc7209-f7db-49d2-9390-66cc835f2819 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:25.497836 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc7209-f7db-49d2-9390-66cc835f2819 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:25.498104 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc7209-f7db-49d2-9390-66cc835f2819 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:25.498819 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fc7209-f7db-49d2-9390-66cc835f2819 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:25.499117 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fc7209-f7db-49d2-9390-66cc835f2819 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:25.500495 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fc7209-f7db-49d2-9390-66cc835f2819 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:25.513008 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 511/1028] 10.222.0.20 () {56 vars in 1115 bytes} [Wed Jul 27 18:53:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:25.514622 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0564fdc-e43e-4188-b93c-9a6e5d9385fa None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:25.518333 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:25.617893 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0564fdc-e43e-4188-b93c-9a6e5d9385fa None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:25.656984 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f9b45b-d538-4e60-aa51-0f8bcc34b7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:25.657628 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f9b45b-d538-4e60-aa51-0f8bcc34b7fd None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:25.657910 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f9b45b-d538-4e60-aa51-0f8bcc34b7fd None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:25.658189 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f9b45b-d538-4e60-aa51-0f8bcc34b7fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:25.668496 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f9b45b-d538-4e60-aa51-0f8bcc34b7fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:25.669927 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f9b45b-d538-4e60-aa51-0f8bcc34b7fd None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:25.686173 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-e9f9b45b-d538-4e60-aa51-0f8bcc34b7fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:53:25.686173 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:25.686173 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:25.686173 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:25.686173 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:25.686173 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:25.686173 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:25.686173 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:25.686173 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:25.686173 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:25.686173 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:25.686173 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:25.686173 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:53:25.686173 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:53:25.686173 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:53:25.687080 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:53:25.687080 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:25.687080 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:25.687080 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:25.687080 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:25.687080 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:25.687080 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:25.687080 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:25.687080 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:25.687080 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:25.687080 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:25.687080 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:25.687080 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:25.687080 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:25.687080 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:25.687080 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:25.687080 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:25.688029 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:53:25.688029 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:53:25.688029 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:53:25.688029 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:25.692127 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 518/1029] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:53:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:53:25.694051 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc7209-f7db-49d2-9390-66cc835f2819 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:25.794185 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc7209-f7db-49d2-9390-66cc835f2819 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:25.810536 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:25.828095 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed90df23-df80-4b80-993f-94109d6573b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:25.828709 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90df23-df80-4b80-993f-94109d6573b7 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:25.828993 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90df23-df80-4b80-993f-94109d6573b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:25.829268 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90df23-df80-4b80-993f-94109d6573b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:25.829961 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed90df23-df80-4b80-993f-94109d6573b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:25.830266 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed90df23-df80-4b80-993f-94109d6573b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:25.831620 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed90df23-df80-4b80-993f-94109d6573b7 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:25.848442 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 512/1030] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:53:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:25.849598 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f9b45b-d538-4e60-aa51-0f8bcc34b7fd None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:25.905822 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:25.952984 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f9b45b-d538-4e60-aa51-0f8bcc34b7fd None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:25.987104 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc093bf9-107e-42cb-abbc-4abe4a2b300f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:25.987763 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc093bf9-107e-42cb-abbc-4abe4a2b300f None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:25.988050 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc093bf9-107e-42cb-abbc-4abe4a2b300f None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:25.988328 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc093bf9-107e-42cb-abbc-4abe4a2b300f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:25.996427 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc093bf9-107e-42cb-abbc-4abe4a2b300f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:25.997848 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc093bf9-107e-42cb-abbc-4abe4a2b300f None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:26.009023 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-bc093bf9-107e-42cb-abbc-4abe4a2b300f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 18:53:26.009023 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:26.009023 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:26.009023 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:26.009023 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:26.009023 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:26.009023 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:26.009023 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:26.009023 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:26.009023 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:26.009023 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:26.009023 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:26.009023 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:53:26.009023 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:53:26.009023 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:53:26.009023 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:53:26.009947 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:26.009947 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:26.009947 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:53:26.009947 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:53:26.009947 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:53:26.009947 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:53:26.009947 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:26.009947 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:26.009947 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:26.009947 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:26.009947 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:26.009947 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:26.009947 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:26.009947 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:26.009947 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:26.009947 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:26.009947 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:26.009947 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:26.010974 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:26.010974 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:26.010974 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:53:26.010974 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:53:26.010974 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:53:26.010974 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:53:26.010974 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:53:26.010974 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:53:26.010974 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 18:53:26.010974 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:26.010974 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 519/1031] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Jul 27 18:53:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:53:26.017465 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed90df23-df80-4b80-993f-94109d6573b7 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:26.122231 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed90df23-df80-4b80-993f-94109d6573b7 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:26.156070 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3e8b77-1fbb-4366-8b02-b824788d106a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:26.156665 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e8b77-1fbb-4366-8b02-b824788d106a None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:26.156948 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e8b77-1fbb-4366-8b02-b824788d106a None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:26.157221 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e8b77-1fbb-4366-8b02-b824788d106a None admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:26.158055 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3e8b77-1fbb-4366-8b02-b824788d106a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:26.158362 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3e8b77-1fbb-4366-8b02-b824788d106a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:26.159868 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3e8b77-1fbb-4366-8b02-b824788d106a None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:26.179368 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 513/1032] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Jul 27 18:53:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:26.183975 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc093bf9-107e-42cb-abbc-4abe4a2b300f None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:26.286610 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc093bf9-107e-42cb-abbc-4abe4a2b300f None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:26.300064 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:26.323235 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc8a63-f10c-4d61-95f1-98a0ea75a6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:26.323984 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc8a63-f10c-4d61-95f1-98a0ea75a6da None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:26.324271 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc8a63-f10c-4d61-95f1-98a0ea75a6da None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:26.324549 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc8a63-f10c-4d61-95f1-98a0ea75a6da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:26.343106 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e43f4-7a63-4e41-89bf-af1f9ea32c79 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:26.343606 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e43f4-7a63-4e41-89bf-af1f9ea32c79 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:26.343923 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e43f4-7a63-4e41-89bf-af1f9ea32c79 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:26.345281 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 514/1033] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:53:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:53:26.350315 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d89f5-cae9-4751-9e4c-14a82226d04c None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:26.350670 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d89f5-cae9-4751-9e4c-14a82226d04c None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:26.351113 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d89f5-cae9-4751-9e4c-14a82226d04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:26.370153 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-df5d89f5-cae9-4751-9e4c-14a82226d04c None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:53:26.371431 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-df5d89f5-cae9-4751-9e4c-14a82226d04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:26.396992 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc8a63-f10c-4d61-95f1-98a0ea75a6da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:26.398597 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc8a63-f10c-4d61-95f1-98a0ea75a6da None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:26.401897 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:26.443923 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 515/1034] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:53:26 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 18:53:26.465684 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d89f5-cae9-4751-9e4c-14a82226d04c None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:26.507356 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 520/1035] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 27 18:53:26 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 18:53:26.508524 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc8a63-f10c-4d61-95f1-98a0ea75a6da None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:26.526359 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:26.581046 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d89f5-cae9-4751-9e4c-14a82226d04c None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:26.618438 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f057d6e-4b01-43d8-9d24-4052d5ec1a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:26.620156 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f057d6e-4b01-43d8-9d24-4052d5ec1a6a None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:26.621525 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f057d6e-4b01-43d8-9d24-4052d5ec1a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:26.621816 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f057d6e-4b01-43d8-9d24-4052d5ec1a6a None admin] PATH_INFO: `/v3/services/image` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:26.623349 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f057d6e-4b01-43d8-9d24-4052d5ec1a6a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:26.624756 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f057d6e-4b01-43d8-9d24-4052d5ec1a6a None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:26.625942 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc8a63-f10c-4d61-95f1-98a0ea75a6da None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:26.634596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-9f057d6e-4b01-43d8-9d24-4052d5ec1a6a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 18:53:26.634596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:26.634596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:53:26.634596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:53:26.634596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:53:26.634596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:53:26.634596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:53:26.634596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:53:26.634596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 18:53:26.634596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:53:26.634596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:53:26.634596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:53:26.634596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:26.634596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:26.634596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:26.634596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:26.634596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:26.635596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:26.635596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:26.635596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:26.635596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:26.635596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:26.635596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:26.635596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:53:26.635596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:53:26.635596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:53:26.635596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:53:26.635596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:26.635596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:26.635596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:26.635596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:26.635596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:26.635596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:26.636477 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:26.636477 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:26.636477 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:26.636477 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:26.636477 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:26.636477 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:26.636477 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:26.636477 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:26.636477 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:26.636477 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:26.636477 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:53:26.636477 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:53:26.636477 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 18:53:26.636477 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:53:26.636477 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 516/1036] 10.222.0.20 () {56 vars in 1105 bytes} [Wed Jul 27 18:53:26 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:53:26.641704 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f057d6e-4b01-43d8-9d24-4052d5ec1a6a None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:26.668891 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce649ba-ef4c-468f-b969-e6e9bac6025a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:26.669695 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce649ba-ef4c-468f-b969-e6e9bac6025a None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:26.669974 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce649ba-ef4c-468f-b969-e6e9bac6025a None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:26.670352 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce649ba-ef4c-468f-b969-e6e9bac6025a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:26.673542 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:26.683747 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce649ba-ef4c-468f-b969-e6e9bac6025a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:26.685901 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce649ba-ef4c-468f-b969-e6e9bac6025a None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:26.701840 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-3ce649ba-ef4c-468f-b969-e6e9bac6025a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:53:26.701840 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:26.701840 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:26.701840 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:26.701840 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:26.701840 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:26.701840 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:26.701840 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:26.701840 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:26.701840 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:26.701840 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:26.701840 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:26.701840 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:53:26.701840 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:53:26.701840 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:53:26.702735 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:53:26.702735 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:26.702735 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:26.702735 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:26.702735 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:26.702735 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:26.702735 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:26.702735 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:26.702735 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:26.702735 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:26.702735 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:26.702735 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:26.702735 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:26.702735 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:26.702735 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:26.702735 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:26.702735 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:26.703621 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:53:26.703621 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:53:26.703621 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:53:26.703621 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:26.703621 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 521/1037] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:53:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:53:26.709063 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce649ba-ef4c-468f-b969-e6e9bac6025a None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:26.756157 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f057d6e-4b01-43d8-9d24-4052d5ec1a6a None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:26.779841 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:26.794650 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c147210-61b5-4afa-875a-96789a4a9f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:26.795273 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c147210-61b5-4afa-875a-96789a4a9f60 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:26.795603 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c147210-61b5-4afa-875a-96789a4a9f60 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:26.795907 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c147210-61b5-4afa-875a-96789a4a9f60 None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:26.796588 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c147210-61b5-4afa-875a-96789a4a9f60 None admin] RBAC: Adding query filter params (name=image) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:26.796894 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c147210-61b5-4afa-875a-96789a4a9f60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:26.798487 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c147210-61b5-4afa-875a-96789a4a9f60 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:26.803709 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 517/1038] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:53:26 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:53:26.809244 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c147210-61b5-4afa-875a-96789a4a9f60 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:26.819074 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce649ba-ef4c-468f-b969-e6e9bac6025a None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:26.854311 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b35202f-4941-4941-bda4-eacd12c0ee34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:26.854924 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35202f-4941-4941-bda4-eacd12c0ee34 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:26.855204 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35202f-4941-4941-bda4-eacd12c0ee34 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:26.855477 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35202f-4941-4941-bda4-eacd12c0ee34 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:26.856196 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b35202f-4941-4941-bda4-eacd12c0ee34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:26.856500 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b35202f-4941-4941-bda4-eacd12c0ee34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:26.857854 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b35202f-4941-4941-bda4-eacd12c0ee34 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:26.871730 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 522/1039] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:53:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:26.876523 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b35202f-4941-4941-bda4-eacd12c0ee34 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:26.914040 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:26.922471 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c147210-61b5-4afa-875a-96789a4a9f60 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:26.962228 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2dae5d-47dc-461d-ac90-80b123535dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:26.962849 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2dae5d-47dc-461d-ac90-80b123535dd1 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:26.964791 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2dae5d-47dc-461d-ac90-80b123535dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:26.964791 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2dae5d-47dc-461d-ac90-80b123535dd1 None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:26.964791 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2dae5d-47dc-461d-ac90-80b123535dd1 None admin] RBAC: Adding query filter params (type=image) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:26.964791 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2dae5d-47dc-461d-ac90-80b123535dd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:26.965753 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2dae5d-47dc-461d-ac90-80b123535dd1 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:26.975447 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 518/1040] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:53:26 2022] GET /identity/v3/services?type=image => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:53:26.981195 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2dae5d-47dc-461d-ac90-80b123535dd1 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:26.996036 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b35202f-4941-4941-bda4-eacd12c0ee34 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:27.022088 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:27.031618 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01905b5f-ec11-4412-8b33-c35d5d46a7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:27.032460 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01905b5f-ec11-4412-8b33-c35d5d46a7b3 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:27.032746 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01905b5f-ec11-4412-8b33-c35d5d46a7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:27.033010 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01905b5f-ec11-4412-8b33-c35d5d46a7b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:27.040166 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01905b5f-ec11-4412-8b33-c35d5d46a7b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:27.041577 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01905b5f-ec11-4412-8b33-c35d5d46a7b3 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:27.052554 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-01905b5f-ec11-4412-8b33-c35d5d46a7b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:53:27.052554 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:27.052554 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:27.052554 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:27.052554 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:27.052554 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:27.052554 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:27.052554 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:27.052554 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:27.052554 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:27.052554 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:27.052554 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:27.052554 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:53:27.052554 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:53:27.052554 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:53:27.053515 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:53:27.053515 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:27.053515 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:27.053515 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:27.053515 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:27.053515 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:27.053515 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:27.053515 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:27.053515 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:27.053515 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:27.053515 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:27.053515 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:27.053515 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:27.053515 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:27.053515 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:27.053515 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:27.053515 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:27.054408 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:53:27.054408 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:53:27.054408 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:53:27.054408 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:53:27.054408 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:53:27.054408 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:53:27.054408 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:53:27.054408 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:27.055971 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 523/1041] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 27 18:53:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:53:27.057054 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aed904-574e-4afa-82d7-41c62264138e None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:27.057339 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aed904-574e-4afa-82d7-41c62264138e None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:27.058116 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aed904-574e-4afa-82d7-41c62264138e None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:27.059387 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 524/1042] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:53:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:53:27.060446 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aed904-574e-4afa-82d7-41c62264138e None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:27.082579 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2dae5d-47dc-461d-ac90-80b123535dd1 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:27.116343 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c29f58c-8ac0-4a57-8bea-23330e42cf8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:27.116956 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29f58c-8ac0-4a57-8bea-23330e42cf8c None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:27.117238 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29f58c-8ac0-4a57-8bea-23330e42cf8c None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:27.117514 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29f58c-8ac0-4a57-8bea-23330e42cf8c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:27.118264 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c29f58c-8ac0-4a57-8bea-23330e42cf8c None admin] RBAC: Adding query filter params (interface=public, service_id=518c4f5048524d9c8b32bd8e2736509e, region_id=RegionOne) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:27.118573 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c29f58c-8ac0-4a57-8bea-23330e42cf8c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:27.119970 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c29f58c-8ac0-4a57-8bea-23330e42cf8c None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:27.124829 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 519/1043] 10.222.0.20 () {56 vars in 1251 bytes} [Wed Jul 27 18:53:26 2022] GET /identity/v3/endpoints?service_id=518c4f5048524d9c8b32bd8e2736509e&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:53:27.129505 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40acf67d-592a-4b5e-b46b-30cf15c728aa None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:27.129505 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40acf67d-592a-4b5e-b46b-30cf15c728aa None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:27.129505 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40acf67d-592a-4b5e-b46b-30cf15c728aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:27.143996 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-40acf67d-592a-4b5e-b46b-30cf15c728aa None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:53:27.145177 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-40acf67d-592a-4b5e-b46b-30cf15c728aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:27.161532 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:27.164438 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aed904-574e-4afa-82d7-41c62264138e None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:27.199608 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea1d4bd-3d4a-4e6d-afde-ce21be9e785c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:27.200255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1d4bd-3d4a-4e6d-afde-ce21be9e785c None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:27.200518 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1d4bd-3d4a-4e6d-afde-ce21be9e785c None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:27.200800 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1d4bd-3d4a-4e6d-afde-ce21be9e785c None admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:27.201539 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea1d4bd-3d4a-4e6d-afde-ce21be9e785c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:27.201848 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea1d4bd-3d4a-4e6d-afde-ce21be9e785c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:27.203262 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea1d4bd-3d4a-4e6d-afde-ce21be9e785c None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:27.214197 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 520/1044] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:53:27 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:53:27.214944 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40acf67d-592a-4b5e-b46b-30cf15c728aa None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:27.220137 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 525/1045] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 27 18:53:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:27.221082 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea1d4bd-3d4a-4e6d-afde-ce21be9e785c None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:27.276463 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:27.317335 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40acf67d-592a-4b5e-b46b-30cf15c728aa None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:27.332957 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea1d4bd-3d4a-4e6d-afde-ce21be9e785c None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:27.350121 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f633b3-2c81-4d64-be0e-e3c7f610730f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:27.350725 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f633b3-2c81-4d64-be0e-e3c7f610730f None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:27.351000 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f633b3-2c81-4d64-be0e-e3c7f610730f None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:27.351267 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f633b3-2c81-4d64-be0e-e3c7f610730f None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:27.351944 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f633b3-2c81-4d64-be0e-e3c7f610730f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:27.353300 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f633b3-2c81-4d64-be0e-e3c7f610730f None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:27.359861 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 521/1046] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Jul 27 18:53:27 2022] GET /identity/v3/services => generated 1957 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:53:27.360624 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f633b3-2c81-4d64-be0e-e3c7f610730f None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:27.375460 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df8e716-dad3-4de4-bb74-c2a484f449cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:27.376136 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8e716-dad3-4de4-bb74-c2a484f449cd None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:27.376421 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8e716-dad3-4de4-bb74-c2a484f449cd None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:27.376698 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8e716-dad3-4de4-bb74-c2a484f449cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:27.377546 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df8e716-dad3-4de4-bb74-c2a484f449cd None admin] RBAC: Adding query filter params (role.id=f388f0bd9c714f86a7657d98f844d701, scope.project.id=31f027c53398443eb548eaf3f24523e0, user.id=17fbef9db7734283aaad4962ee160171) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:27.377857 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df8e716-dad3-4de4-bb74-c2a484f449cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:27.379332 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df8e716-dad3-4de4-bb74-c2a484f449cd None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:27.381177 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:27.386228 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 526/1047] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 27 18:53:27 2022] GET /identity/v3/role_assignments?user.id=17fbef9db7734283aaad4962ee160171&scope.project.id=31f027c53398443eb548eaf3f24523e0&role.id=f388f0bd9c714f86a7657d98f844d701 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:53:27.478428 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f633b3-2c81-4d64-be0e-e3c7f610730f None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:27.518370 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c0e7c8-69da-4029-b566-2789c0473032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:27.519362 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0e7c8-69da-4029-b566-2789c0473032 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:27.519862 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0e7c8-69da-4029-b566-2789c0473032 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:27.520304 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0e7c8-69da-4029-b566-2789c0473032 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:27.538613 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c0e7c8-69da-4029-b566-2789c0473032 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:53:27.543557 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-24c0e7c8-69da-4029-b566-2789c0473032 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:53:27.543557 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:27.543557 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:27.543557 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:27.543557 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:27.543557 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:27.543557 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:27.543557 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:27.543557 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:27.543557 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:27.543557 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:27.543557 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:27.543557 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:53:27.543557 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:53:27.543557 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:53:27.543557 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:53:27.544504 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:53:27.544504 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:53:27.544504 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:53:27.544504 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:53:27.544504 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:27.544504 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:27.544504 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:27.544504 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:27.544504 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:27.544504 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:27.544504 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:27.544504 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:27.544504 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:27.544504 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:27.544504 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:27.544504 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:27.545357 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:27.545357 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:27.545357 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:27.545357 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:27.545357 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:53:27.545357 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:53:27.545357 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:53:27.545357 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:53:27.545357 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:53:27.545357 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:53:27.545357 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:53:27.545357 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:53:27.545357 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 522/1048] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 27 18:53:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:53:27.550887 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df8e716-dad3-4de4-bb74-c2a484f449cd None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:27.655626 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df8e716-dad3-4de4-bb74-c2a484f449cd None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:27.667210 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:27.694427 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f1b213-223c-4e24-af02-d280dc198aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:27.695287 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1b213-223c-4e24-af02-d280dc198aec None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:27.695743 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1b213-223c-4e24-af02-d280dc198aec None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:27.696238 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1b213-223c-4e24-af02-d280dc198aec None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:27.697104 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f1b213-223c-4e24-af02-d280dc198aec None admin] RBAC: Adding query filter params (name=admin) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:27.697577 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f1b213-223c-4e24-af02-d280dc198aec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:27.699090 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f1b213-223c-4e24-af02-d280dc198aec None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:27.713791 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 527/1049] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 27 18:53:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:27.715270 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c0e7c8-69da-4029-b566-2789c0473032 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:27.795326 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:27.819596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c0e7c8-69da-4029-b566-2789c0473032 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:27.855550 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a335ebf1-2e90-4bf3-a1dd-216016d73b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:27.856444 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335ebf1-2e90-4bf3-a1dd-216016d73b15 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:27.856876 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335ebf1-2e90-4bf3-a1dd-216016d73b15 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:27.857319 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335ebf1-2e90-4bf3-a1dd-216016d73b15 None admin] PATH_INFO: `/v3/users/5b6310ec517f4378a7109ae5fcf5147d` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:27.871282 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a335ebf1-2e90-4bf3-a1dd-216016d73b15 None admin] RBAC: Authorizing `identity:get_user(user_id=5b6310ec517f4378a7109ae5fcf5147d)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:27.872941 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a335ebf1-2e90-4bf3-a1dd-216016d73b15 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:27.875081 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 523/1050] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 27 18:53:27 2022] GET /identity/v3/users/5b6310ec517f4378a7109ae5fcf5147d => generated 285 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:27.881107 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f1b213-223c-4e24-af02-d280dc198aec None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:27.982595 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f1b213-223c-4e24-af02-d280dc198aec None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:28.016956 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8d658-ed01-4af6-b593-bb0fda136c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:28.017565 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8d658-ed01-4af6-b593-bb0fda136c6e None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:28.017844 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8d658-ed01-4af6-b593-bb0fda136c6e None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:28.018111 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8d658-ed01-4af6-b593-bb0fda136c6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:28.058418 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:28.086910 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc8d658-ed01-4af6-b593-bb0fda136c6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:28.088373 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc8d658-ed01-4af6-b593-bb0fda136c6e None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:28.188760 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 528/1051] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 27 18:53:27 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 18:53:28.189966 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a335ebf1-2e90-4bf3-a1dd-216016d73b15 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:28.288327 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a335ebf1-2e90-4bf3-a1dd-216016d73b15 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:28.320639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f88540b-90d6-4af9-a424-36ad6013d249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:28.321276 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f88540b-90d6-4af9-a424-36ad6013d249 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:28.321610 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f88540b-90d6-4af9-a424-36ad6013d249 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:28.321934 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f88540b-90d6-4af9-a424-36ad6013d249 None admin] PATH_INFO: `/v3/projects/5aaf9fa526ca4cfea8785c89cef83d07` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:28.323089 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f88540b-90d6-4af9-a424-36ad6013d249 None admin] RBAC: Authorizing `identity:get_project(project_id=5aaf9fa526ca4cfea8785c89cef83d07)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:28.324518 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f88540b-90d6-4af9-a424-36ad6013d249 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:28.326306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 524/1052] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 27 18:53:28 2022] GET /identity/v3/projects/5aaf9fa526ca4cfea8785c89cef83d07 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:53:28.332173 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8d658-ed01-4af6-b593-bb0fda136c6e None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:28.401735 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:28.432590 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8d658-ed01-4af6-b593-bb0fda136c6e None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:28.466872 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ac9f1-98bc-4090-85c3-5dc5ca4055e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:28.467480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ac9f1-98bc-4090-85c3-5dc5ca4055e3 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:28.467781 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ac9f1-98bc-4090-85c3-5dc5ca4055e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:28.468053 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ac9f1-98bc-4090-85c3-5dc5ca4055e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:28.468830 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ac9f1-98bc-4090-85c3-5dc5ca4055e3 None admin] RBAC: Adding query filter params (role.id=0f4a39b061e148418413cfe647af9a34, scope.project.id=5aaf9fa526ca4cfea8785c89cef83d07, user.id=5b6310ec517f4378a7109ae5fcf5147d) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:28.469138 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ac9f1-98bc-4090-85c3-5dc5ca4055e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:28.470565 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ac9f1-98bc-4090-85c3-5dc5ca4055e3 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:28.477559 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 529/1053] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 27 18:53:28 2022] GET /identity/v3/role_assignments?user.id=5b6310ec517f4378a7109ae5fcf5147d&scope.project.id=5aaf9fa526ca4cfea8785c89cef83d07&role.id=0f4a39b061e148418413cfe647af9a34 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:29.382891 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef41c01-82d4-4001-ae8f-f1077ccbd735 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:29.383420 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef41c01-82d4-4001-ae8f-f1077ccbd735 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:29.383420 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef41c01-82d4-4001-ae8f-f1077ccbd735 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:29.385807 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 525/1054] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:53:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:53:29.390221 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb054e-95b2-4d4a-9edd-df4b55c19650 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:29.390360 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee331f-5cc0-4bb0-82fc-5f6b676fdf7c None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:29.390736 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb054e-95b2-4d4a-9edd-df4b55c19650 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:29.390835 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee331f-5cc0-4bb0-82fc-5f6b676fdf7c None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:29.390910 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb054e-95b2-4d4a-9edd-df4b55c19650 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:29.390996 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee331f-5cc0-4bb0-82fc-5f6b676fdf7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:29.392218 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 526/1055] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:53:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:53:29.397466 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555f6a5-6e24-4ff9-9fe0-991848409fea None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:29.397754 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555f6a5-6e24-4ff9-9fe0-991848409fea None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:29.398299 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555f6a5-6e24-4ff9-9fe0-991848409fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:29.405413 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:29.409671 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-82ee331f-5cc0-4bb0-82fc-5f6b676fdf7c None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:53:29.410862 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-82ee331f-5cc0-4bb0-82fc-5f6b676fdf7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:29.419473 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-0555f6a5-6e24-4ff9-9fe0-991848409fea None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:53:29.421027 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-0555f6a5-6e24-4ff9-9fe0-991848409fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:29.480830 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 530/1056] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:53:29 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:53:29.490372 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 527/1057] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:53:29 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 18:53:29.502965 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee331f-5cc0-4bb0-82fc-5f6b676fdf7c None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:29.513288 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0555f6a5-6e24-4ff9-9fe0-991848409fea None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:29.580382 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:29.623063 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0555f6a5-6e24-4ff9-9fe0-991848409fea None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:29.626785 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee331f-5cc0-4bb0-82fc-5f6b676fdf7c None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:29.652528 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:29.658047 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f263a1e-647b-434f-90ee-0cd4bbf0c9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:29.658680 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f263a1e-647b-434f-90ee-0cd4bbf0c9e8 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:29.658955 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f263a1e-647b-434f-90ee-0cd4bbf0c9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:29.659221 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f263a1e-647b-434f-90ee-0cd4bbf0c9e8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:29.668888 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80c0457-d7a8-478a-ade9-72c98f1424ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:29.669996 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c0457-d7a8-478a-ade9-72c98f1424ec None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:29.670117 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f263a1e-647b-434f-90ee-0cd4bbf0c9e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:53:29.670541 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c0457-d7a8-478a-ade9-72c98f1424ec None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:29.670972 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c0457-d7a8-478a-ade9-72c98f1424ec None admin] PATH_INFO: `/v3/services/image` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:29.671767 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80c0457-d7a8-478a-ade9-72c98f1424ec None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:29.673266 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80c0457-d7a8-478a-ade9-72c98f1424ec None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:29.674811 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-3f263a1e-647b-434f-90ee-0cd4bbf0c9e8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 18:53:29.674811 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:29.674811 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:29.674811 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:29.674811 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:29.674811 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:29.674811 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:29.674811 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:29.674811 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:29.674811 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:29.674811 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:29.674811 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:29.674811 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:53:29.674811 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:53:29.674811 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:53:29.674811 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:53:29.675943 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:53:29.675943 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:53:29.675943 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:53:29.675943 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:53:29.675943 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:29.675943 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:29.675943 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:29.675943 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:29.675943 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:29.675943 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:29.675943 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:29.675943 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:29.675943 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:29.675943 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:29.675943 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:29.675943 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:29.676937 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:29.676937 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:29.676937 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:29.676937 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:29.676937 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:53:29.676937 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:53:29.676937 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:53:29.676937 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:53:29.676937 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:53:29.676937 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:53:29.676937 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 18:53:29.676937 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:53:29.676937 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 528/1058] 10.222.0.20 () {56 vars in 1120 bytes} [Wed Jul 27 18:53:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:53:29.682248 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f263a1e-647b-434f-90ee-0cd4bbf0c9e8 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:29.687146 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-b80c0457-d7a8-478a-ade9-72c98f1424ec None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 18:53:29.687146 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:29.687146 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:53:29.687146 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:53:29.687146 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:53:29.687146 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:53:29.687146 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:53:29.687146 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:53:29.687146 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 18:53:29.687146 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:29.687146 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:53:29.687146 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:29.687146 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:29.687146 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:29.687146 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:29.687146 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:29.687146 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:29.688353 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:29.688353 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:29.688353 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:29.688353 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:29.688353 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:29.688353 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:29.688353 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:53:29.688353 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:53:29.688353 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:53:29.688353 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:53:29.688353 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:29.688353 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:29.688353 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:29.688353 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:29.688353 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:29.688353 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:29.689404 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:29.689404 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:29.689404 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:29.689404 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:29.689404 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:29.689404 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:29.689404 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:29.689404 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:29.689404 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:29.689404 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:29.689404 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:53:29.689404 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:53:29.689404 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 18:53:29.689404 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:29.692286 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 531/1059] 10.222.0.20 () {56 vars in 1105 bytes} [Wed Jul 27 18:53:29 2022] GET /identity/v3/services/image => generated 86 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:53:29.698214 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80c0457-d7a8-478a-ade9-72c98f1424ec None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:29.786718 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f263a1e-647b-434f-90ee-0cd4bbf0c9e8 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:29.808394 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80c0457-d7a8-478a-ade9-72c98f1424ec None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:29.823329 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c73b6df-7424-426c-b90e-ea55aa45265b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:29.824071 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73b6df-7424-426c-b90e-ea55aa45265b None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:29.824347 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73b6df-7424-426c-b90e-ea55aa45265b None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:29.824795 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73b6df-7424-426c-b90e-ea55aa45265b None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:29.825494 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c73b6df-7424-426c-b90e-ea55aa45265b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:29.825800 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c73b6df-7424-426c-b90e-ea55aa45265b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:29.827169 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c73b6df-7424-426c-b90e-ea55aa45265b None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:29.840694 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 529/1060] 10.222.0.20 () {56 vars in 1115 bytes} [Wed Jul 27 18:53:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:53:29.841663 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c73b6df-7424-426c-b90e-ea55aa45265b None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:29.844288 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:29.852759 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6011a1-ec27-4390-a690-4aaec8f77421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:29.853553 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6011a1-ec27-4390-a690-4aaec8f77421 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:29.853975 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6011a1-ec27-4390-a690-4aaec8f77421 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:29.854416 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6011a1-ec27-4390-a690-4aaec8f77421 None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:29.855270 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6011a1-ec27-4390-a690-4aaec8f77421 None admin] RBAC: Adding query filter params (name=image) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:29.855748 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6011a1-ec27-4390-a690-4aaec8f77421 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:29.857227 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6011a1-ec27-4390-a690-4aaec8f77421 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:29.867394 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 532/1061] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:53:29 2022] GET /identity/v3/services?name=image => generated 122 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:29.868531 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6011a1-ec27-4390-a690-4aaec8f77421 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:29.899409 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:29.952297 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c73b6df-7424-426c-b90e-ea55aa45265b None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:29.976050 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6011a1-ec27-4390-a690-4aaec8f77421 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:29.990285 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7774eae-adfb-45ed-968b-199c98c6e2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:29.990935 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7774eae-adfb-45ed-968b-199c98c6e2dc None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:29.991213 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7774eae-adfb-45ed-968b-199c98c6e2dc None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:29.991482 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7774eae-adfb-45ed-968b-199c98c6e2dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:30.002882 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7774eae-adfb-45ed-968b-199c98c6e2dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:30.004496 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7774eae-adfb-45ed-968b-199c98c6e2dc None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:30.010815 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b7c39-9f0c-49df-8415-aaa0427984ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:30.011862 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b7c39-9f0c-49df-8415-aaa0427984ce None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:30.012149 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b7c39-9f0c-49df-8415-aaa0427984ce None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:30.012420 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b7c39-9f0c-49df-8415-aaa0427984ce None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:30.013467 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608b7c39-9f0c-49df-8415-aaa0427984ce None admin] RBAC: Adding query filter params (type=image) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:30.013779 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608b7c39-9f0c-49df-8415-aaa0427984ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:30.015272 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608b7c39-9f0c-49df-8415-aaa0427984ce None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:30.019245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-d7774eae-adfb-45ed-968b-199c98c6e2dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:53:30.019245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:30.019245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:30.019245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:30.019245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:30.019245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:30.019245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:30.019245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:30.019245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:30.019245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:30.019245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:30.019245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:30.019245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:53:30.019245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:53:30.019245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:53:30.020142 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:53:30.020142 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:30.020142 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:30.020142 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:30.020142 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:30.020142 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:30.020142 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:30.020142 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:30.020142 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:30.020142 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:30.020142 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:30.020142 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:30.020142 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:30.020142 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:30.020142 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:30.020142 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:30.020142 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:30.021158 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:53:30.021158 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:53:30.021158 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:53:30.021158 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:53:30.021379 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 533/1062] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:53:29 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:30.028504 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 530/1063] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:53:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:53:30.028626 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b7c39-9f0c-49df-8415-aaa0427984ce None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:30.029388 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7774eae-adfb-45ed-968b-199c98c6e2dc None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:30.088433 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:30.133619 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b7c39-9f0c-49df-8415-aaa0427984ce None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:30.137739 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7774eae-adfb-45ed-968b-199c98c6e2dc None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:30.144813 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:30.170561 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7359790a-455e-4ffd-89c4-aa433a11ce96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:30.171182 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359790a-455e-4ffd-89c4-aa433a11ce96 None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:30.171466 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359790a-455e-4ffd-89c4-aa433a11ce96 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:30.171776 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359790a-455e-4ffd-89c4-aa433a11ce96 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:30.172479 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7359790a-455e-4ffd-89c4-aa433a11ce96 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:30.173833 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7359790a-455e-4ffd-89c4-aa433a11ce96 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:30.177824 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef614c12-6376-4df3-b93c-5014643d712c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:30.178600 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef614c12-6376-4df3-b93c-5014643d712c None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:30.179014 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef614c12-6376-4df3-b93c-5014643d712c None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:30.179506 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef614c12-6376-4df3-b93c-5014643d712c None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:30.180362 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef614c12-6376-4df3-b93c-5014643d712c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:30.180808 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef614c12-6376-4df3-b93c-5014643d712c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:30.182296 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef614c12-6376-4df3-b93c-5014643d712c None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:30.199728 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 534/1064] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Jul 27 18:53:30 2022] POST /identity/v3/endpoints => generated 327 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:53:30.199958 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 531/1065] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:53:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:30.201085 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7359790a-455e-4ffd-89c4-aa433a11ce96 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:30.322166 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7359790a-455e-4ffd-89c4-aa433a11ce96 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:30.334693 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:30.366594 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3256e-a611-448d-a5c0-e26af2002201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:30.367243 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3256e-a611-448d-a5c0-e26af2002201 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:30.367526 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3256e-a611-448d-a5c0-e26af2002201 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:30.367830 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3256e-a611-448d-a5c0-e26af2002201 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:30.375620 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b3256e-a611-448d-a5c0-e26af2002201 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:30.377075 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b3256e-a611-448d-a5c0-e26af2002201 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:30.388510 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-e5b3256e-a611-448d-a5c0-e26af2002201 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 18:53:30.388510 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:30.388510 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:30.388510 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:30.388510 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:30.388510 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:30.388510 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:30.388510 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:30.388510 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:30.388510 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:30.388510 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:30.388510 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:30.388510 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:53:30.388510 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:53:30.388510 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:53:30.388510 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:53:30.389444 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:30.389444 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:30.389444 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:53:30.389444 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:53:30.389444 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:53:30.389444 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:53:30.389444 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:30.389444 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:30.389444 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:30.389444 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:30.389444 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:30.389444 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:30.389444 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:30.389444 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:30.389444 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:30.389444 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:30.389444 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:30.389444 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:30.390422 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:30.390422 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:30.390422 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:53:30.390422 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:53:30.390422 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:53:30.390422 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:53:30.390422 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:53:30.390422 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:53:30.390422 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 18:53:30.390422 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:30.390422 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 535/1066] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Jul 27 18:53:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:53:30.397366 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef614c12-6376-4df3-b93c-5014643d712c None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:30.456265 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235fd34-4731-472e-90fa-60d01754da45 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:30.456617 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235fd34-4731-472e-90fa-60d01754da45 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:30.456912 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235fd34-4731-472e-90fa-60d01754da45 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:30.459031 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 536/1067] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:53:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:53:30.464544 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09d8b9-f899-4511-ab1e-6927d1e3f138 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:30.464825 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09d8b9-f899-4511-ab1e-6927d1e3f138 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:30.465099 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09d8b9-f899-4511-ab1e-6927d1e3f138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:30.483936 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-9a09d8b9-f899-4511-ab1e-6927d1e3f138 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:53:30.485475 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-9a09d8b9-f899-4511-ab1e-6927d1e3f138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:30.502902 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef614c12-6376-4df3-b93c-5014643d712c None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:30.544132 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b8e9f-c7f8-4305-9f43-5e0485a5f0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:30.544755 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b8e9f-c7f8-4305-9f43-5e0485a5f0c8 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:30.545038 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b8e9f-c7f8-4305-9f43-5e0485a5f0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:30.545313 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b8e9f-c7f8-4305-9f43-5e0485a5f0c8 None admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:30.546118 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282b8e9f-c7f8-4305-9f43-5e0485a5f0c8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:30.546426 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282b8e9f-c7f8-4305-9f43-5e0485a5f0c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:30.547905 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282b8e9f-c7f8-4305-9f43-5e0485a5f0c8 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:30.570242 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 532/1068] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Jul 27 18:53:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:30.570423 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 537/1069] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:53:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 18:53:30.571417 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b8e9f-c7f8-4305-9f43-5e0485a5f0c8 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:30.587519 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a09d8b9-f899-4511-ab1e-6927d1e3f138 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:30.597388 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:30.686912 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b8e9f-c7f8-4305-9f43-5e0485a5f0c8 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:30.700452 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:30.704164 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a09d8b9-f899-4511-ab1e-6927d1e3f138 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:30.722703 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf7ab16-79b7-4e97-8c0b-d7f2e4d6f7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:30.723342 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7ab16-79b7-4e97-8c0b-d7f2e4d6f7a8 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:30.723625 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7ab16-79b7-4e97-8c0b-d7f2e4d6f7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:30.723959 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7ab16-79b7-4e97-8c0b-d7f2e4d6f7a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:30.735038 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf7ab16-79b7-4e97-8c0b-d7f2e4d6f7a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:30.736510 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf7ab16-79b7-4e97-8c0b-d7f2e4d6f7a8 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:30.742754 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9157463-8b28-42af-8d29-b95a4fa1cdc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:30.743790 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9157463-8b28-42af-8d29-b95a4fa1cdc7 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:30.744072 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9157463-8b28-42af-8d29-b95a4fa1cdc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:30.744346 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9157463-8b28-42af-8d29-b95a4fa1cdc7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:30.751596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-7bf7ab16-79b7-4e97-8c0b-d7f2e4d6f7a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:53:30.751596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:30.751596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:30.751596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:30.751596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:30.751596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:30.751596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:30.751596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:30.751596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:30.751596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:30.751596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:30.751596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:30.751596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:53:30.751596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:53:30.751596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:53:30.752513 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:53:30.752513 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:30.752513 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:30.752513 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:30.752513 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:30.752513 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:30.752513 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:30.752513 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:30.752513 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:30.752513 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:30.752513 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:30.752513 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:30.752513 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:30.752513 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:30.752513 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:30.752513 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:30.752513 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:30.753426 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:53:30.753426 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:53:30.753426 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:53:30.753426 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:53:30.753426 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 533/1070] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:53:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:53:30.757268 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9157463-8b28-42af-8d29-b95a4fa1cdc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:53:30.758528 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf7ab16-79b7-4e97-8c0b-d7f2e4d6f7a8 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:30.762497 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-f9157463-8b28-42af-8d29-b95a4fa1cdc7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:53:30.762497 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:30.762497 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:30.762497 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:30.762497 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:30.762497 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:30.762497 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:30.762497 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:30.762497 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:30.762497 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:30.762497 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:30.762497 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:30.762497 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:53:30.762497 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:53:30.762497 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:53:30.762497 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:53:30.763649 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:53:30.763649 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:53:30.763649 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:53:30.763649 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:53:30.763649 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:30.763649 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:30.763649 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:30.763649 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:30.763649 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:30.763649 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:30.763649 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:30.763649 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:30.763649 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:30.763649 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:30.763649 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:30.763649 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:30.764909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:30.764909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:30.764909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:30.764909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:30.764909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:53:30.764909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:53:30.764909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:53:30.764909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:53:30.764909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:53:30.764909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:53:30.764909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:53:30.764909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:30.764909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 538/1071] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 27 18:53:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:53:30.769367 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9157463-8b28-42af-8d29-b95a4fa1cdc7 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:30.846216 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:30.872836 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf7ab16-79b7-4e97-8c0b-d7f2e4d6f7a8 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:30.874772 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9157463-8b28-42af-8d29-b95a4fa1cdc7 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:30.910559 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb3be63-79eb-4f28-9d42-141d4e1b1da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:30.911174 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3be63-79eb-4f28-9d42-141d4e1b1da2 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:30.911516 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3be63-79eb-4f28-9d42-141d4e1b1da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:30.911825 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3be63-79eb-4f28-9d42-141d4e1b1da2 None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:30.912149 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16e5d46-fec1-4f48-ac98-a855a071585b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:30.912517 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb3be63-79eb-4f28-9d42-141d4e1b1da2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:30.912763 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e5d46-fec1-4f48-ac98-a855a071585b None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:30.912869 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb3be63-79eb-4f28-9d42-141d4e1b1da2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:30.913036 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e5d46-fec1-4f48-ac98-a855a071585b None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:30.913308 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e5d46-fec1-4f48-ac98-a855a071585b None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:30.914021 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16e5d46-fec1-4f48-ac98-a855a071585b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:30.914192 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb3be63-79eb-4f28-9d42-141d4e1b1da2 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:30.914351 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16e5d46-fec1-4f48-ac98-a855a071585b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:30.915669 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16e5d46-fec1-4f48-ac98-a855a071585b None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:30.924930 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 539/1072] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 27 18:53:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:53:30.926344 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 534/1073] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:53:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:53:30.932348 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16e5d46-fec1-4f48-ac98-a855a071585b None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:30.933575 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb3be63-79eb-4f28-9d42-141d4e1b1da2 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:30.957455 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:31.037866 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16e5d46-fec1-4f48-ac98-a855a071585b None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:31.046865 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb3be63-79eb-4f28-9d42-141d4e1b1da2 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:31.081306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf57e50-250e-41d1-8781-6f274de9483a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:31.081944 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf57e50-250e-41d1-8781-6f274de9483a None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:31.082230 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf57e50-250e-41d1-8781-6f274de9483a None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:31.082510 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf57e50-250e-41d1-8781-6f274de9483a None admin] PATH_INFO: `/v3/users/5b6310ec517f4378a7109ae5fcf5147d` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:31.084286 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf57e50-250e-41d1-8781-6f274de9483a None admin] RBAC: Authorizing `identity:get_user(user_id=5b6310ec517f4378a7109ae5fcf5147d)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:31.085716 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf57e50-250e-41d1-8781-6f274de9483a None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:31.087386 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 540/1074] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 27 18:53:30 2022] GET /identity/v3/users/5b6310ec517f4378a7109ae5fcf5147d => generated 285 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:31.088068 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41247a8-73f5-4d71-84c2-e6ca484c8ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:31.089077 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41247a8-73f5-4d71-84c2-e6ca484c8ca2 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:31.089503 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41247a8-73f5-4d71-84c2-e6ca484c8ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:31.089918 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41247a8-73f5-4d71-84c2-e6ca484c8ca2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:31.093198 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf57e50-250e-41d1-8781-6f274de9483a None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:31.095271 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:31.103318 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41247a8-73f5-4d71-84c2-e6ca484c8ca2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:31.104923 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41247a8-73f5-4d71-84c2-e6ca484c8ca2 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:31.117306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-d41247a8-73f5-4d71-84c2-e6ca484c8ca2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:53:31.117306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:31.117306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:31.117306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:31.117306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:31.117306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:31.117306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:31.117306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:31.117306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:31.117306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:31.117306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:31.117306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:31.117306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:53:31.117306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:53:31.117306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:53:31.118190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:53:31.118190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:31.118190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:31.118190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:31.118190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:31.118190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:31.118190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:31.118190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:31.118190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:31.118190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:31.118190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:31.118190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:31.118190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:31.118190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:31.118190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:31.118190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:31.118190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:31.124602 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:53:31.124602 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:53:31.124602 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:53:31.124602 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:53:31.124602 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:53:31.124602 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:53:31.124602 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:53:31.124602 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:53:31.124602 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 535/1075] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 27 18:53:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:53:31.124602 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41247a8-73f5-4d71-84c2-e6ca484c8ca2 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:31.201935 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:31.211284 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf57e50-250e-41d1-8781-6f274de9483a None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:31.236449 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41247a8-73f5-4d71-84c2-e6ca484c8ca2 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:31.248498 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b7178-123c-475f-9dde-ee714e25e533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:31.249138 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b7178-123c-475f-9dde-ee714e25e533 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:31.249421 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b7178-123c-475f-9dde-ee714e25e533 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:31.249695 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b7178-123c-475f-9dde-ee714e25e533 None admin] PATH_INFO: `/v3/projects/5aaf9fa526ca4cfea8785c89cef83d07` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:31.250856 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548b7178-123c-475f-9dde-ee714e25e533 None admin] RBAC: Authorizing `identity:get_project(project_id=5aaf9fa526ca4cfea8785c89cef83d07)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:31.252313 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548b7178-123c-475f-9dde-ee714e25e533 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:31.253973 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 541/1076] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 27 18:53:31 2022] GET /identity/v3/projects/5aaf9fa526ca4cfea8785c89cef83d07 => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:53:31.259927 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b7178-123c-475f-9dde-ee714e25e533 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:31.278168 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c518a0-eea3-459e-a052-5b6b6251159d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:31.278778 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c518a0-eea3-459e-a052-5b6b6251159d None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:31.279058 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c518a0-eea3-459e-a052-5b6b6251159d None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:31.279332 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c518a0-eea3-459e-a052-5b6b6251159d None admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:31.280105 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c518a0-eea3-459e-a052-5b6b6251159d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:31.280412 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c518a0-eea3-459e-a052-5b6b6251159d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:31.281835 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c518a0-eea3-459e-a052-5b6b6251159d None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:31.298840 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 536/1077] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 27 18:53:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:31.300310 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c518a0-eea3-459e-a052-5b6b6251159d None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:31.356652 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:31.366549 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b7178-123c-475f-9dde-ee714e25e533 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:31.404356 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2046e10-4064-416b-9266-8db8cd909869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:31.405025 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2046e10-4064-416b-9266-8db8cd909869 None admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:31.405301 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2046e10-4064-416b-9266-8db8cd909869 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:31.405572 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2046e10-4064-416b-9266-8db8cd909869 None admin] PATH_INFO: `/v3/projects/5aaf9fa526ca4cfea8785c89cef83d07/users/5b6310ec517f4378a7109ae5fcf5147d/roles/0f4a39b061e148418413cfe647af9a34` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:31.407152 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c518a0-eea3-459e-a052-5b6b6251159d None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:31.408564 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2046e10-4064-416b-9266-8db8cd909869 None admin] RBAC: Authorizing `identity:create_grant(project_id=5aaf9fa526ca4cfea8785c89cef83d07, user_id=5b6310ec517f4378a7109ae5fcf5147d, role_id=0f4a39b061e148418413cfe647af9a34)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:31.409798 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2046e10-4064-416b-9266-8db8cd909869 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:31.426757 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 542/1078] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 27 18:53:31 2022] PUT /identity/v3/projects/5aaf9fa526ca4cfea8785c89cef83d07/users/5b6310ec517f4378a7109ae5fcf5147d/roles/0f4a39b061e148418413cfe647af9a34 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:53:31.450602 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e1ef0d-d864-4653-81e0-b42796ad20b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:31.451300 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1ef0d-d864-4653-81e0-b42796ad20b4 None admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:31.451583 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1ef0d-d864-4653-81e0-b42796ad20b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:31.451894 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1ef0d-d864-4653-81e0-b42796ad20b4 None admin] PATH_INFO: `/v3/projects/31f027c53398443eb548eaf3f24523e0/users/17fbef9db7734283aaad4962ee160171/roles/f388f0bd9c714f86a7657d98f844d701` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:31.454231 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e1ef0d-d864-4653-81e0-b42796ad20b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=31f027c53398443eb548eaf3f24523e0, user_id=17fbef9db7734283aaad4962ee160171, role_id=f388f0bd9c714f86a7657d98f844d701)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:31.455721 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e1ef0d-d864-4653-81e0-b42796ad20b4 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:31.470817 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 537/1079] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 27 18:53:31 2022] PUT /identity/v3/projects/31f027c53398443eb548eaf3f24523e0/users/17fbef9db7734283aaad4962ee160171/roles/f388f0bd9c714f86a7657d98f844d701 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:53:32.356426 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566de1a9-17b9-43dc-a87e-84a60d32152f None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:32.356823 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566de1a9-17b9-43dc-a87e-84a60d32152f None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:32.356997 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566de1a9-17b9-43dc-a87e-84a60d32152f None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:32.358374 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 543/1080] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:53:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:53:32.363706 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb39731-b3ab-450c-bc3b-a95e5ed735c4 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:32.364082 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb39731-b3ab-450c-bc3b-a95e5ed735c4 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:32.364438 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb39731-b3ab-450c-bc3b-a95e5ed735c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:32.382593 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-fbb39731-b3ab-450c-bc3b-a95e5ed735c4 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:53:32.383789 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-fbb39731-b3ab-450c-bc3b-a95e5ed735c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:32.458002 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 538/1081] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:53:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:53:32.479792 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566de1a9-17b9-43dc-a87e-84a60d32152f None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:32.500321 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:32.594604 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566de1a9-17b9-43dc-a87e-84a60d32152f None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:32.630715 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd7de8-88e7-4e9c-842e-743c3753bde4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:32.631251 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd7de8-88e7-4e9c-842e-743c3753bde4 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:32.631532 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd7de8-88e7-4e9c-842e-743c3753bde4 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:32.631848 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd7de8-88e7-4e9c-842e-743c3753bde4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:32.705478 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bd7de8-88e7-4e9c-842e-743c3753bde4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:32.706915 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bd7de8-88e7-4e9c-842e-743c3753bde4 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:32.724632 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:32.821551 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 544/1082] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 27 18:53:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 18:53:32.823037 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb39731-b3ab-450c-bc3b-a95e5ed735c4 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:32.870025 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:32.925100 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb39731-b3ab-450c-bc3b-a95e5ed735c4 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:32.958719 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f8e74-f058-49c6-a8e8-55c7afe43c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:32.959354 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f8e74-f058-49c6-a8e8-55c7afe43c3b None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:32.959630 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f8e74-f058-49c6-a8e8-55c7afe43c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:32.959926 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f8e74-f058-49c6-a8e8-55c7afe43c3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:32.969742 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6f8e74-f058-49c6-a8e8-55c7afe43c3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:32.971155 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6f8e74-f058-49c6-a8e8-55c7afe43c3b None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:32.986146 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-bb6f8e74-f058-49c6-a8e8-55c7afe43c3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:53:32.986146 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:32.986146 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:32.986146 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:32.986146 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:32.986146 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:32.986146 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:32.986146 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:32.986146 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:32.986146 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:32.986146 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:32.986146 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:32.986146 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:53:32.986146 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:53:32.986146 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:53:32.987038 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:53:32.987038 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:32.987038 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:32.987038 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:32.987038 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:32.987038 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:32.987038 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:32.987038 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:32.987038 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:32.987038 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:32.987038 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:32.987038 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:32.987038 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:32.987038 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:32.987038 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:32.987038 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:32.987038 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:32.987981 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:53:32.987981 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:53:32.987981 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:53:32.987981 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:53:32.992035 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 539/1083] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:53:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:53:32.994218 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd7de8-88e7-4e9c-842e-743c3753bde4 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:33.101932 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd7de8-88e7-4e9c-842e-743c3753bde4 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:33.125791 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:33.148728 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc4ce7-48e0-49bd-bbe5-f1033a167680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:33.149356 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc4ce7-48e0-49bd-bbe5-f1033a167680 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:33.149796 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc4ce7-48e0-49bd-bbe5-f1033a167680 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:33.150300 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc4ce7-48e0-49bd-bbe5-f1033a167680 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:33.151584 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cc4ce7-48e0-49bd-bbe5-f1033a167680 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:33.151982 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cc4ce7-48e0-49bd-bbe5-f1033a167680 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:33.153350 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cc4ce7-48e0-49bd-bbe5-f1033a167680 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:33.175808 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 545/1084] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:53:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:53:33.468175 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f21ed9-dc3a-48b9-ba54-d7a287d9c90c None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:33.468668 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f21ed9-dc3a-48b9-ba54-d7a287d9c90c None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:33.468668 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f21ed9-dc3a-48b9-ba54-d7a287d9c90c None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:33.469996 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 540/1085] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:53:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:53:33.475412 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5817bfe-def8-4ca4-8752-ce49f972173c None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:33.475708 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5817bfe-def8-4ca4-8752-ce49f972173c None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:33.476003 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5817bfe-def8-4ca4-8752-ce49f972173c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:33.495571 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-d5817bfe-def8-4ca4-8752-ce49f972173c None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:53:33.496794 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-d5817bfe-def8-4ca4-8752-ce49f972173c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:33.525829 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c9a4e-35c8-4a85-9576-41e027392d7f None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:33.526344 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c9a4e-35c8-4a85-9576-41e027392d7f None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:33.526622 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c9a4e-35c8-4a85-9576-41e027392d7f None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:33.528022 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 541/1086] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:53:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:53:33.533817 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de36a7-80c5-41a1-a3b9-e9358f0258d5 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:33.534105 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de36a7-80c5-41a1-a3b9-e9358f0258d5 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:33.534384 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de36a7-80c5-41a1-a3b9-e9358f0258d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:33.553137 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-a5de36a7-80c5-41a1-a3b9-e9358f0258d5 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:53:33.553984 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-a5de36a7-80c5-41a1-a3b9-e9358f0258d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:33.569318 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 546/1087] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:53:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:53:33.592422 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5817bfe-def8-4ca4-8752-ce49f972173c None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:33.620936 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 542/1088] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:53:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 18:53:33.644059 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de36a7-80c5-41a1-a3b9-e9358f0258d5 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:33.669758 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:33.691252 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5817bfe-def8-4ca4-8752-ce49f972173c None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:33.701180 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:33.726145 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbf750c-e48d-4850-b44c-4564e43ac79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:33.726716 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf750c-e48d-4850-b44c-4564e43ac79b None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:33.726998 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf750c-e48d-4850-b44c-4564e43ac79b None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:33.727275 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf750c-e48d-4850-b44c-4564e43ac79b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:33.737583 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbf750c-e48d-4850-b44c-4564e43ac79b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:53:33.739906 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de36a7-80c5-41a1-a3b9-e9358f0258d5 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:33.744172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-6bbf750c-e48d-4850-b44c-4564e43ac79b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:53:33.744172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:33.744172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:33.744172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:33.744172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:33.744172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:33.744172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:33.744172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:33.744172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:33.744172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:33.744172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:33.744172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:33.744172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:53:33.744172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:53:33.744172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:53:33.744172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:53:33.745306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:53:33.745306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:53:33.745306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:53:33.745306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:53:33.745306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:33.745306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:33.745306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:33.745306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:33.745306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:33.745306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:33.745306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:33.745306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:33.745306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:33.745306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:33.745306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:33.745306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:33.746221 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:33.746221 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:33.746221 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:33.746221 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:33.746221 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:53:33.746221 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:53:33.746221 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:53:33.746221 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:53:33.746221 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:53:33.746221 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:53:33.746221 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:53:33.746221 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:33.746221 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 547/1089] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 27 18:53:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:53:33.751202 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbf750c-e48d-4850-b44c-4564e43ac79b None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:33.774176 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d9758-b961-46ba-a8f2-9ce5987c54e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:33.774810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d9758-b961-46ba-a8f2-9ce5987c54e0 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:33.775087 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d9758-b961-46ba-a8f2-9ce5987c54e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:33.775355 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d9758-b961-46ba-a8f2-9ce5987c54e0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:33.785430 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19d9758-b961-46ba-a8f2-9ce5987c54e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:53:33.790274 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-d19d9758-b961-46ba-a8f2-9ce5987c54e0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 18:53:33.790274 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:33.790274 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:33.790274 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:33.790274 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:33.790274 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:33.790274 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:33.790274 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:33.790274 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:33.790274 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:33.790274 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:33.790274 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:33.790274 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:53:33.790274 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:53:33.790274 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:53:33.790274 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:53:33.791276 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:53:33.791276 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:53:33.791276 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:53:33.791276 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:53:33.791276 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:33.791276 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:33.791276 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:33.791276 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:33.791276 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:33.791276 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:33.791276 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:33.791276 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:33.791276 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:33.791276 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:33.791276 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:33.791276 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:33.792336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:33.792336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:33.792336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:33.792336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:33.792336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:53:33.792336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:53:33.792336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:53:33.792336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:53:33.792336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:53:33.792336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:53:33.792336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 18:53:33.792336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:53:33.792336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 543/1090] 10.222.0.20 () {56 vars in 1120 bytes} [Wed Jul 27 18:53:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:53:33.797251 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d9758-b961-46ba-a8f2-9ce5987c54e0 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:33.851912 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbf750c-e48d-4850-b44c-4564e43ac79b None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:33.884723 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:33.885466 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d1a1d-bcf4-4550-ba79-97057e239571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:33.886351 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d1a1d-bcf4-4550-ba79-97057e239571 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:33.886615 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d1a1d-bcf4-4550-ba79-97057e239571 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:33.886916 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d1a1d-bcf4-4550-ba79-97057e239571 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:33.887630 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4d1a1d-bcf4-4550-ba79-97057e239571 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:33.887967 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4d1a1d-bcf4-4550-ba79-97057e239571 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:33.889319 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4d1a1d-bcf4-4550-ba79-97057e239571 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:33.897022 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d9758-b961-46ba-a8f2-9ce5987c54e0 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:33.897771 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 548/1091] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 27 18:53:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:53:33.903539 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d1a1d-bcf4-4550-ba79-97057e239571 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:33.930426 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871351d4-d7ec-4510-b44a-2a7352066a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:33.931033 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871351d4-d7ec-4510-b44a-2a7352066a11 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:33.931311 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871351d4-d7ec-4510-b44a-2a7352066a11 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:33.931580 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871351d4-d7ec-4510-b44a-2a7352066a11 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:33.932317 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871351d4-d7ec-4510-b44a-2a7352066a11 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:33.932618 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871351d4-d7ec-4510-b44a-2a7352066a11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:33.933511 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:33.933978 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871351d4-d7ec-4510-b44a-2a7352066a11 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:33.941784 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 544/1092] 10.222.0.20 () {56 vars in 1115 bytes} [Wed Jul 27 18:53:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:53:33.947844 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871351d4-d7ec-4510-b44a-2a7352066a11 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:34.008654 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d1a1d-bcf4-4550-ba79-97057e239571 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:34.042499 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda4bc1-3fa0-4aa7-bced-4778286abaf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:34.043136 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda4bc1-3fa0-4aa7-bced-4778286abaf3 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:34.043420 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda4bc1-3fa0-4aa7-bced-4778286abaf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:34.043713 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda4bc1-3fa0-4aa7-bced-4778286abaf3 None admin] PATH_INFO: `/v3/users/5b6310ec517f4378a7109ae5fcf5147d` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:34.044890 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eda4bc1-3fa0-4aa7-bced-4778286abaf3 None admin] RBAC: Authorizing `identity:get_user(user_id=5b6310ec517f4378a7109ae5fcf5147d)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:34.046304 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eda4bc1-3fa0-4aa7-bced-4778286abaf3 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:34.052674 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 549/1093] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 27 18:53:33 2022] GET /identity/v3/users/5b6310ec517f4378a7109ae5fcf5147d => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:53:34.052813 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871351d4-d7ec-4510-b44a-2a7352066a11 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:34.053640 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda4bc1-3fa0-4aa7-bced-4778286abaf3 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:34.082972 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6978278-8639-43c9-a590-b9124980a648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:34.084300 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6978278-8639-43c9-a590-b9124980a648 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:34.084580 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6978278-8639-43c9-a590-b9124980a648 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:34.084847 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6978278-8639-43c9-a590-b9124980a648 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:34.094890 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6978278-8639-43c9-a590-b9124980a648 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:34.096343 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6978278-8639-43c9-a590-b9124980a648 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:34.110078 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-c6978278-8639-43c9-a590-b9124980a648 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:53:34.110078 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:34.110078 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:34.110078 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:34.110078 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:34.110078 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:34.110078 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:34.110078 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:34.110078 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:34.110078 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:34.110078 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:34.110078 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:34.110078 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:53:34.110078 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:53:34.110078 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:53:34.110961 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:53:34.110961 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:34.110961 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:34.110961 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:34.110961 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:34.110961 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:34.110961 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:34.110961 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:34.110961 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:34.110961 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:34.110961 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:34.110961 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:34.110961 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:34.110961 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:34.110961 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:34.110961 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:34.110961 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:34.111944 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:53:34.111944 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:53:34.111944 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:53:34.111944 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:53:34.111944 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 545/1094] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:53:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:53:34.117033 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6978278-8639-43c9-a590-b9124980a648 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:34.119463 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:34.150308 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:34.153910 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda4bc1-3fa0-4aa7-bced-4778286abaf3 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:34.186567 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2589193b-736b-4c48-86cb-03dbedeca9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:34.187177 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589193b-736b-4c48-86cb-03dbedeca9fb None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:34.187458 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589193b-736b-4c48-86cb-03dbedeca9fb None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:34.187769 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589193b-736b-4c48-86cb-03dbedeca9fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:34.216031 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6978278-8639-43c9-a590-b9124980a648 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:34.249468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e048c2c-40d2-43ba-974b-1e133dc0677b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:34.250103 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e048c2c-40d2-43ba-974b-1e133dc0677b None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:34.250384 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e048c2c-40d2-43ba-974b-1e133dc0677b None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:34.250658 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e048c2c-40d2-43ba-974b-1e133dc0677b None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:34.251345 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e048c2c-40d2-43ba-974b-1e133dc0677b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:34.251658 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e048c2c-40d2-43ba-974b-1e133dc0677b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:34.253045 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e048c2c-40d2-43ba-974b-1e133dc0677b None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:34.254844 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2589193b-736b-4c48-86cb-03dbedeca9fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:34.256306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2589193b-736b-4c48-86cb-03dbedeca9fb None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:34.264777 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 546/1095] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:53:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:53:34.270135 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e048c2c-40d2-43ba-974b-1e133dc0677b None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:34.328641 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:34.349535 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:34.355852 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 550/1096] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 27 18:53:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 18:53:34.360275 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2589193b-736b-4c48-86cb-03dbedeca9fb None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:34.367616 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e048c2c-40d2-43ba-974b-1e133dc0677b None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:34.401598 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7d23e-c02a-4779-8b0e-a6dcbf29bedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:34.402227 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7d23e-c02a-4779-8b0e-a6dcbf29bedc None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:34.402502 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7d23e-c02a-4779-8b0e-a6dcbf29bedc None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:34.402771 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7d23e-c02a-4779-8b0e-a6dcbf29bedc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:34.409538 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b7d23e-c02a-4779-8b0e-a6dcbf29bedc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:34.410952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b7d23e-c02a-4779-8b0e-a6dcbf29bedc None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:34.422670 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-b5b7d23e-c02a-4779-8b0e-a6dcbf29bedc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 18:53:34.422670 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:34.422670 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:34.422670 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:34.422670 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:34.422670 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:34.422670 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:34.422670 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:34.422670 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:34.422670 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:34.422670 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:34.422670 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:34.422670 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:53:34.422670 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:53:34.422670 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:53:34.422670 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:53:34.423593 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:34.423593 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:34.423593 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:53:34.423593 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:53:34.423593 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:53:34.423593 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:53:34.423593 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:34.423593 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:34.423593 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:34.423593 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:34.423593 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:34.423593 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:34.423593 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:34.423593 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:34.423593 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:34.423593 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:34.423593 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:34.423593 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:34.424654 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:34.424654 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:34.424654 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:53:34.424654 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:53:34.424654 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:53:34.424654 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:53:34.424654 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:53:34.424654 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:53:34.424654 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 18:53:34.424654 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:53:34.424654 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 547/1097] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Jul 27 18:53:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:53:34.429386 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7d23e-c02a-4779-8b0e-a6dcbf29bedc None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:34.459967 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2589193b-736b-4c48-86cb-03dbedeca9fb None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:34.493112 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a4036-d771-4b03-bffd-15a16c27d1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:34.493745 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a4036-d771-4b03-bffd-15a16c27d1cf None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:34.494047 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a4036-d771-4b03-bffd-15a16c27d1cf None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:34.494313 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a4036-d771-4b03-bffd-15a16c27d1cf None admin] PATH_INFO: `/v3/projects/5aaf9fa526ca4cfea8785c89cef83d07` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:34.495489 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a4036-d771-4b03-bffd-15a16c27d1cf None admin] RBAC: Authorizing `identity:get_project(project_id=5aaf9fa526ca4cfea8785c89cef83d07)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:34.496941 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a4036-d771-4b03-bffd-15a16c27d1cf None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:34.498578 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 551/1098] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 27 18:53:34 2022] GET /identity/v3/projects/5aaf9fa526ca4cfea8785c89cef83d07 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:53:34.504627 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a4036-d771-4b03-bffd-15a16c27d1cf None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:34.532805 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7d23e-c02a-4779-8b0e-a6dcbf29bedc None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:34.555386 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:34.567975 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d0952-93d8-44fa-9d35-a008cff3ea8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:34.568624 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d0952-93d8-44fa-9d35-a008cff3ea8b None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:34.568904 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d0952-93d8-44fa-9d35-a008cff3ea8b None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:34.569176 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d0952-93d8-44fa-9d35-a008cff3ea8b None admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:34.569848 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:34.569982 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801d0952-93d8-44fa-9d35-a008cff3ea8b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:34.570436 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801d0952-93d8-44fa-9d35-a008cff3ea8b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:34.572027 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801d0952-93d8-44fa-9d35-a008cff3ea8b None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:34.589435 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 548/1099] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Jul 27 18:53:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:53:34.594967 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d0952-93d8-44fa-9d35-a008cff3ea8b None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:34.605750 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a4036-d771-4b03-bffd-15a16c27d1cf None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:34.639371 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e75e7ac-497f-46b3-85cd-74d963044e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:34.640026 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75e7ac-497f-46b3-85cd-74d963044e10 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:34.640307 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75e7ac-497f-46b3-85cd-74d963044e10 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:34.640574 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75e7ac-497f-46b3-85cd-74d963044e10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:34.641356 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e75e7ac-497f-46b3-85cd-74d963044e10 None admin] RBAC: Adding query filter params (role.id=0f4a39b061e148418413cfe647af9a34, scope.project.id=5aaf9fa526ca4cfea8785c89cef83d07, user.id=5b6310ec517f4378a7109ae5fcf5147d) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:34.641665 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e75e7ac-497f-46b3-85cd-74d963044e10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:34.643069 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e75e7ac-497f-46b3-85cd-74d963044e10 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:34.662288 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 552/1100] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 27 18:53:34 2022] GET /identity/v3/role_assignments?user.id=5b6310ec517f4378a7109ae5fcf5147d&scope.project.id=5aaf9fa526ca4cfea8785c89cef83d07&role.id=0f4a39b061e148418413cfe647af9a34 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:53:34.694236 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d0952-93d8-44fa-9d35-a008cff3ea8b None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:34.730053 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab9ac1-8944-422c-8be4-006473f3387d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:34.730677 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab9ac1-8944-422c-8be4-006473f3387d None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:34.730952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab9ac1-8944-422c-8be4-006473f3387d None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:34.731220 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab9ac1-8944-422c-8be4-006473f3387d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:34.780922 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:34.800709 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab9ac1-8944-422c-8be4-006473f3387d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:34.802106 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab9ac1-8944-422c-8be4-006473f3387d None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:34.899206 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 549/1101] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 27 18:53:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 27 18:53:34.905261 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e75e7ac-497f-46b3-85cd-74d963044e10 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:35.007781 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e75e7ac-497f-46b3-85cd-74d963044e10 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:35.037249 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:35.043376 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c41dea-9923-4f5d-b02d-f9dba8d0146f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:35.044046 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c41dea-9923-4f5d-b02d-f9dba8d0146f None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:35.044324 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c41dea-9923-4f5d-b02d-f9dba8d0146f None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:35.044592 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c41dea-9923-4f5d-b02d-f9dba8d0146f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:35.055730 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c41dea-9923-4f5d-b02d-f9dba8d0146f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:35.057079 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c41dea-9923-4f5d-b02d-f9dba8d0146f None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:35.071757 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-55c41dea-9923-4f5d-b02d-f9dba8d0146f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:53:35.071757 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:35.071757 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:35.071757 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:35.071757 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:35.071757 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:35.071757 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:35.071757 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:35.071757 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:35.071757 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:35.071757 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:35.071757 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:35.071757 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:53:35.071757 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:53:35.071757 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:53:35.072838 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:53:35.072838 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:35.072838 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:35.072838 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:35.072838 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:35.072838 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:35.072838 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:35.072838 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:35.072838 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:35.072838 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:35.072838 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:35.072838 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:35.072838 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:35.072838 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:35.072838 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:35.072838 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:35.072838 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:35.078489 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:53:35.078489 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:53:35.078489 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:53:35.078489 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:35.078489 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 553/1102] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:53:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:53:35.078763 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab9ac1-8944-422c-8be4-006473f3387d None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:35.154843 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:35.173614 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab9ac1-8944-422c-8be4-006473f3387d None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:35.206393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6950918c-92c6-47a6-9c78-e294f3cd9549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:35.206994 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950918c-92c6-47a6-9c78-e294f3cd9549 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:35.207270 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950918c-92c6-47a6-9c78-e294f3cd9549 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:35.207540 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950918c-92c6-47a6-9c78-e294f3cd9549 None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:35.208279 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6950918c-92c6-47a6-9c78-e294f3cd9549 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:35.208577 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6950918c-92c6-47a6-9c78-e294f3cd9549 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:35.209915 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6950918c-92c6-47a6-9c78-e294f3cd9549 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:35.220645 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 550/1103] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:53:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:35.226686 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c41dea-9923-4f5d-b02d-f9dba8d0146f None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:35.324402 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c41dea-9923-4f5d-b02d-f9dba8d0146f None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:35.356220 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942444df-3dda-4f06-b27c-18f1d41f7cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:35.356854 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942444df-3dda-4f06-b27c-18f1d41f7cc2 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:35.357133 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942444df-3dda-4f06-b27c-18f1d41f7cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:35.357405 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942444df-3dda-4f06-b27c-18f1d41f7cc2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:35.364826 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942444df-3dda-4f06-b27c-18f1d41f7cc2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:35.366239 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942444df-3dda-4f06-b27c-18f1d41f7cc2 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:35.377276 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-942444df-3dda-4f06-b27c-18f1d41f7cc2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:53:35.377276 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:35.377276 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:35.377276 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:35.377276 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:35.377276 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:35.377276 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:35.377276 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:35.377276 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:35.377276 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:35.377276 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:35.377276 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:35.377276 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:53:35.377276 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:53:35.377276 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:53:35.378315 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:53:35.378315 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:35.378315 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:35.378315 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:35.378315 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:35.378315 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:35.378315 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:35.378315 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:35.378315 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:35.378315 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:35.378315 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:35.378315 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:35.378315 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:35.378315 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:35.378315 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:35.378315 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:35.378315 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:35.379237 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:53:35.379237 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:53:35.379237 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:53:35.379237 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:53:35.379237 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:53:35.379237 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:53:35.379237 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:53:35.379237 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:35.379237 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 554/1104] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 27 18:53:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:53:35.384875 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6950918c-92c6-47a6-9c78-e294f3cd9549 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:35.482618 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6950918c-92c6-47a6-9c78-e294f3cd9549 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:35.516389 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1edd8-06c8-466c-945d-eae3c9cdd2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:35.517238 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1edd8-06c8-466c-945d-eae3c9cdd2d9 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:35.517520 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1edd8-06c8-466c-945d-eae3c9cdd2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:35.517793 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1edd8-06c8-466c-945d-eae3c9cdd2d9 None admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:35.518550 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c1edd8-06c8-466c-945d-eae3c9cdd2d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:35.518862 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c1edd8-06c8-466c-945d-eae3c9cdd2d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:35.520320 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c1edd8-06c8-466c-945d-eae3c9cdd2d9 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:35.534900 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:35.543980 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 551/1105] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 27 18:53:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:35.549013 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942444df-3dda-4f06-b27c-18f1d41f7cc2 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:35.591840 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:35.649719 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942444df-3dda-4f06-b27c-18f1d41f7cc2 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:35.683862 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efea3dd-9a9b-440d-bdcf-5f9d033d548d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:35.684471 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efea3dd-9a9b-440d-bdcf-5f9d033d548d None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:35.684808 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efea3dd-9a9b-440d-bdcf-5f9d033d548d None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:35.685082 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efea3dd-9a9b-440d-bdcf-5f9d033d548d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:35.685884 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efea3dd-9a9b-440d-bdcf-5f9d033d548d None admin] RBAC: Adding query filter params (role.id=f388f0bd9c714f86a7657d98f844d701, scope.project.id=31f027c53398443eb548eaf3f24523e0, user.id=17fbef9db7734283aaad4962ee160171) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:35.686196 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efea3dd-9a9b-440d-bdcf-5f9d033d548d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:35.687605 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efea3dd-9a9b-440d-bdcf-5f9d033d548d None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:35.693279 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 555/1106] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 27 18:53:35 2022] GET /identity/v3/role_assignments?user.id=17fbef9db7734283aaad4962ee160171&scope.project.id=31f027c53398443eb548eaf3f24523e0&role.id=f388f0bd9c714f86a7657d98f844d701 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:53:36.685763 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b311062-d20a-464f-8a4f-2d439aabecd6 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:36.686274 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b311062-d20a-464f-8a4f-2d439aabecd6 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:36.686360 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b311062-d20a-464f-8a4f-2d439aabecd6 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:36.687658 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 552/1107] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:53:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:53:36.693263 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c6b9ef-aed7-4e44-8490-a93421b96f5d None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:36.693685 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c6b9ef-aed7-4e44-8490-a93421b96f5d None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:36.693816 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c6b9ef-aed7-4e44-8490-a93421b96f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:36.712166 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-b2c6b9ef-aed7-4e44-8490-a93421b96f5d None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:53:36.713351 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-b2c6b9ef-aed7-4e44-8490-a93421b96f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:36.782717 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 556/1108] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:53:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:53:36.806928 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b311062-d20a-464f-8a4f-2d439aabecd6 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:36.905855 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b311062-d20a-464f-8a4f-2d439aabecd6 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:36.939770 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb2fa6-a344-49e6-929c-372b1c9c5c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:36.940425 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb2fa6-a344-49e6-929c-372b1c9c5c4c None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:36.940706 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb2fa6-a344-49e6-929c-372b1c9c5c4c None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:36.940983 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb2fa6-a344-49e6-929c-372b1c9c5c4c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:36.942127 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbb2fa6-a344-49e6-929c-372b1c9c5c4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:36.943549 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbb2fa6-a344-49e6-929c-372b1c9c5c4c None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:36.945178 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 553/1109] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:53:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:36.951012 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c6b9ef-aed7-4e44-8490-a93421b96f5d None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:36.984105 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:37.046191 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c6b9ef-aed7-4e44-8490-a93421b96f5d None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:37.078904 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a5928-4395-4c41-8812-682ce9c1c70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:37.079511 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a5928-4395-4c41-8812-682ce9c1c70b None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:37.079821 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a5928-4395-4c41-8812-682ce9c1c70b None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:37.080101 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a5928-4395-4c41-8812-682ce9c1c70b None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:37.080772 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58a5928-4395-4c41-8812-682ce9c1c70b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:37.082186 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58a5928-4395-4c41-8812-682ce9c1c70b None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:37.103187 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 557/1110] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Jul 27 18:53:36 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:53:39.124504 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529de7d-1c16-4260-81d4-58f39a3d6761 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:39.125031 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529de7d-1c16-4260-81d4-58f39a3d6761 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:39.125031 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529de7d-1c16-4260-81d4-58f39a3d6761 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:39.126383 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 554/1111] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:53:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:53:39.132295 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d4b48e-693d-400e-a46c-c3ea1c22d60d None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:39.132697 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d4b48e-693d-400e-a46c-c3ea1c22d60d None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:39.132833 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d4b48e-693d-400e-a46c-c3ea1c22d60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:39.150262 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-f5d4b48e-693d-400e-a46c-c3ea1c22d60d None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:53:39.151425 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-f5d4b48e-693d-400e-a46c-c3ea1c22d60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:39.215240 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 558/1112] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:53:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:53:39.241624 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f529de7d-1c16-4260-81d4-58f39a3d6761 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:39.306788 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:39.338756 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f529de7d-1c16-4260-81d4-58f39a3d6761 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:39.371265 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a08f71d-dc2d-4cdc-b950-77bf1acaa0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:39.371904 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08f71d-dc2d-4cdc-b950-77bf1acaa0cf None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:39.372179 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08f71d-dc2d-4cdc-b950-77bf1acaa0cf None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:39.372446 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08f71d-dc2d-4cdc-b950-77bf1acaa0cf None admin] PATH_INFO: `/v3/roles/8d808722e03a4591a59440f170ec672f` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:39.373848 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a08f71d-dc2d-4cdc-b950-77bf1acaa0cf None admin] RBAC: Authorizing `identity:get_role(role_id=8d808722e03a4591a59440f170ec672f)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:39.375235 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a08f71d-dc2d-4cdc-b950-77bf1acaa0cf None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:39.376531 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 555/1113] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 27 18:53:39 2022] GET /identity/v3/roles/8d808722e03a4591a59440f170ec672f => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:39.382341 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d4b48e-693d-400e-a46c-c3ea1c22d60d None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:39.405136 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:39.477826 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d4b48e-693d-400e-a46c-c3ea1c22d60d None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:39.510586 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66345847-244a-4638-9a19-2e3c473ce3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:39.511207 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66345847-244a-4638-9a19-2e3c473ce3e6 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:39.511482 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66345847-244a-4638-9a19-2e3c473ce3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:39.511784 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66345847-244a-4638-9a19-2e3c473ce3e6 None admin] PATH_INFO: `/v3/users/ea872c5b8dd04caf9d53c8100e0e4f61` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:39.527000 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66345847-244a-4638-9a19-2e3c473ce3e6 None admin] RBAC: Authorizing `identity:get_user(user_id=ea872c5b8dd04caf9d53c8100e0e4f61)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:39.528492 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66345847-244a-4638-9a19-2e3c473ce3e6 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:39.530176 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 559/1114] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 27 18:53:39 2022] GET /identity/v3/users/ea872c5b8dd04caf9d53c8100e0e4f61 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:39.538254 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a08f71d-dc2d-4cdc-b950-77bf1acaa0cf None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:39.632237 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a08f71d-dc2d-4cdc-b950-77bf1acaa0cf None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:39.664634 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f90a8-dd3a-4204-bf5d-419cc65b493f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:39.665227 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f90a8-dd3a-4204-bf5d-419cc65b493f None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:39.665504 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f90a8-dd3a-4204-bf5d-419cc65b493f None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:39.665775 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f90a8-dd3a-4204-bf5d-419cc65b493f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:39.669057 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:39.731034 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f90a8-dd3a-4204-bf5d-419cc65b493f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:39.732493 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f90a8-dd3a-4204-bf5d-419cc65b493f None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:39.830702 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 556/1115] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 27 18:53:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 18:53:39.836725 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66345847-244a-4638-9a19-2e3c473ce3e6 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:39.915559 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:39.934663 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66345847-244a-4638-9a19-2e3c473ce3e6 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:39.966827 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ef6038-ad6e-495e-8451-4ecaa001ad65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:39.967451 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef6038-ad6e-495e-8451-4ecaa001ad65 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:39.967757 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef6038-ad6e-495e-8451-4ecaa001ad65 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:39.968037 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef6038-ad6e-495e-8451-4ecaa001ad65 None admin] PATH_INFO: `/v3/projects/5aaf9fa526ca4cfea8785c89cef83d07` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:39.969181 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ef6038-ad6e-495e-8451-4ecaa001ad65 None admin] RBAC: Authorizing `identity:get_project(project_id=5aaf9fa526ca4cfea8785c89cef83d07)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:39.970595 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ef6038-ad6e-495e-8451-4ecaa001ad65 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:39.972254 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 560/1116] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 27 18:53:39 2022] GET /identity/v3/projects/5aaf9fa526ca4cfea8785c89cef83d07 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:39.978659 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f90a8-dd3a-4204-bf5d-419cc65b493f None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:40.012158 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:40.074991 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f90a8-dd3a-4204-bf5d-419cc65b493f None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:40.107331 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc102ad-31d0-4ea8-8179-4a808220556a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:40.107960 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc102ad-31d0-4ea8-8179-4a808220556a None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:40.108239 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc102ad-31d0-4ea8-8179-4a808220556a None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:40.108509 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc102ad-31d0-4ea8-8179-4a808220556a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:40.109539 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc102ad-31d0-4ea8-8179-4a808220556a None admin] RBAC: Adding query filter params (role.id=8d808722e03a4591a59440f170ec672f, scope.project.id=5aaf9fa526ca4cfea8785c89cef83d07, user.id=ea872c5b8dd04caf9d53c8100e0e4f61) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:40.109842 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc102ad-31d0-4ea8-8179-4a808220556a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:40.111261 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc102ad-31d0-4ea8-8179-4a808220556a None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:40.117079 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 557/1117] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 27 18:53:39 2022] GET /identity/v3/role_assignments?user.id=ea872c5b8dd04caf9d53c8100e0e4f61&scope.project.id=5aaf9fa526ca4cfea8785c89cef83d07&role.id=8d808722e03a4591a59440f170ec672f => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:42.080902 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e3749-f822-4a05-9aa8-1a895d0b09f3 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:42.081493 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e3749-f822-4a05-9aa8-1a895d0b09f3 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:42.081493 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e3749-f822-4a05-9aa8-1a895d0b09f3 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:42.083312 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 561/1118] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:53:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:53:42.088465 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3b9c7-11bc-403c-a782-9ab71fdbaf1e None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:42.088863 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3b9c7-11bc-403c-a782-9ab71fdbaf1e None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:42.089007 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3b9c7-11bc-403c-a782-9ab71fdbaf1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:42.106927 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-eef3b9c7-11bc-403c-a782-9ab71fdbaf1e None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:53:42.108144 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-eef3b9c7-11bc-403c-a782-9ab71fdbaf1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:42.171837 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 558/1119] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:53:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:53:42.193906 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e3749-f822-4a05-9aa8-1a895d0b09f3 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:42.290873 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e3749-f822-4a05-9aa8-1a895d0b09f3 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:42.323550 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5290f1-bbf6-4aa0-9534-1f0d5be79bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:42.324188 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5290f1-bbf6-4aa0-9534-1f0d5be79bea None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:42.324465 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5290f1-bbf6-4aa0-9534-1f0d5be79bea None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:42.324735 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5290f1-bbf6-4aa0-9534-1f0d5be79bea None admin] PATH_INFO: `/v3/roles/8d808722e03a4591a59440f170ec672f` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:42.326139 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5290f1-bbf6-4aa0-9534-1f0d5be79bea None admin] RBAC: Authorizing `identity:get_role(role_id=8d808722e03a4591a59440f170ec672f)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:42.327472 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5290f1-bbf6-4aa0-9534-1f0d5be79bea None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:42.328797 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 562/1120] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 27 18:53:42 2022] GET /identity/v3/roles/8d808722e03a4591a59440f170ec672f => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:42.338884 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3b9c7-11bc-403c-a782-9ab71fdbaf1e None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:42.370441 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:42.436669 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3b9c7-11bc-403c-a782-9ab71fdbaf1e None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:42.469694 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a19d74-5a96-4f96-bf78-121f00b5dd13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:42.470315 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a19d74-5a96-4f96-bf78-121f00b5dd13 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:42.470596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a19d74-5a96-4f96-bf78-121f00b5dd13 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:42.470871 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a19d74-5a96-4f96-bf78-121f00b5dd13 None admin] PATH_INFO: `/v3/users/ea872c5b8dd04caf9d53c8100e0e4f61` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:42.472047 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a19d74-5a96-4f96-bf78-121f00b5dd13 None admin] RBAC: Authorizing `identity:get_user(user_id=ea872c5b8dd04caf9d53c8100e0e4f61)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:42.473686 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a19d74-5a96-4f96-bf78-121f00b5dd13 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:42.476591 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 559/1121] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 27 18:53:42 2022] GET /identity/v3/users/ea872c5b8dd04caf9d53c8100e0e4f61 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:42.483185 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5290f1-bbf6-4aa0-9534-1f0d5be79bea None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:42.503211 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:42.586335 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5290f1-bbf6-4aa0-9534-1f0d5be79bea None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:42.618963 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d8f522-2cf8-4d09-8215-c3aeabb9942c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:42.619523 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d8f522-2cf8-4d09-8215-c3aeabb9942c None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:42.619829 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d8f522-2cf8-4d09-8215-c3aeabb9942c None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:42.620101 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d8f522-2cf8-4d09-8215-c3aeabb9942c None admin] PATH_INFO: `/v3/projects/5aaf9fa526ca4cfea8785c89cef83d07` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:42.621226 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d8f522-2cf8-4d09-8215-c3aeabb9942c None admin] RBAC: Authorizing `identity:get_project(project_id=5aaf9fa526ca4cfea8785c89cef83d07)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:42.622629 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d8f522-2cf8-4d09-8215-c3aeabb9942c None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:42.624286 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 563/1122] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 27 18:53:42 2022] GET /identity/v3/projects/5aaf9fa526ca4cfea8785c89cef83d07 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:42.630955 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a19d74-5a96-4f96-bf78-121f00b5dd13 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:42.721719 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:42.725524 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a19d74-5a96-4f96-bf78-121f00b5dd13 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:42.759352 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5557de80-cbe5-4de8-9c4f-4efb775e0d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:42.760029 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5557de80-cbe5-4de8-9c4f-4efb775e0d71 None admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:42.760308 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5557de80-cbe5-4de8-9c4f-4efb775e0d71 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:42.760579 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5557de80-cbe5-4de8-9c4f-4efb775e0d71 None admin] PATH_INFO: `/v3/projects/5aaf9fa526ca4cfea8785c89cef83d07/users/ea872c5b8dd04caf9d53c8100e0e4f61/roles/8d808722e03a4591a59440f170ec672f` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:42.762700 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5557de80-cbe5-4de8-9c4f-4efb775e0d71 None admin] RBAC: Authorizing `identity:create_grant(project_id=5aaf9fa526ca4cfea8785c89cef83d07, user_id=ea872c5b8dd04caf9d53c8100e0e4f61, role_id=8d808722e03a4591a59440f170ec672f)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:42.764143 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5557de80-cbe5-4de8-9c4f-4efb775e0d71 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:42.775925 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 560/1123] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 27 18:53:42 2022] PUT /identity/v3/projects/5aaf9fa526ca4cfea8785c89cef83d07/users/ea872c5b8dd04caf9d53c8100e0e4f61/roles/8d808722e03a4591a59440f170ec672f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:53:44.714514 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca0286-9608-45c4-a1ef-b31e8ba028f4 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:44.715060 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca0286-9608-45c4-a1ef-b31e8ba028f4 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:44.715060 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca0286-9608-45c4-a1ef-b31e8ba028f4 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:44.716452 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 564/1124] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:53:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:53:44.721560 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f592aa57-be48-4362-8c01-a31720e023b7 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:44.721969 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f592aa57-be48-4362-8c01-a31720e023b7 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:44.722116 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f592aa57-be48-4362-8c01-a31720e023b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:44.740426 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-f592aa57-be48-4362-8c01-a31720e023b7 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:53:44.741601 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-f592aa57-be48-4362-8c01-a31720e023b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:44.805279 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 561/1125] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:53:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:53:44.828307 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caca0286-9608-45c4-a1ef-b31e8ba028f4 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:44.916759 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:44.933599 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caca0286-9608-45c4-a1ef-b31e8ba028f4 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:44.966296 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec73a2-65ac-4685-92dc-c01025fdae49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:44.966919 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec73a2-65ac-4685-92dc-c01025fdae49 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:44.967200 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec73a2-65ac-4685-92dc-c01025fdae49 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:44.967476 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec73a2-65ac-4685-92dc-c01025fdae49 None admin] PATH_INFO: `/v3/roles/8d808722e03a4591a59440f170ec672f` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:44.968935 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ec73a2-65ac-4685-92dc-c01025fdae49 None admin] RBAC: Authorizing `identity:get_role(role_id=8d808722e03a4591a59440f170ec672f)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:44.970287 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ec73a2-65ac-4685-92dc-c01025fdae49 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:44.971623 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 565/1126] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 27 18:53:44 2022] GET /identity/v3/roles/8d808722e03a4591a59440f170ec672f => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:44.977524 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f592aa57-be48-4362-8c01-a31720e023b7 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:45.060111 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:45.072797 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f592aa57-be48-4362-8c01-a31720e023b7 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:45.104329 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41675799-e681-443d-adf4-ad17549ffe4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:45.104951 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41675799-e681-443d-adf4-ad17549ffe4c None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:45.105231 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41675799-e681-443d-adf4-ad17549ffe4c None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:45.105502 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41675799-e681-443d-adf4-ad17549ffe4c None admin] PATH_INFO: `/v3/users/ea872c5b8dd04caf9d53c8100e0e4f61` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:45.106648 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41675799-e681-443d-adf4-ad17549ffe4c None admin] RBAC: Authorizing `identity:get_user(user_id=ea872c5b8dd04caf9d53c8100e0e4f61)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:45.108089 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41675799-e681-443d-adf4-ad17549ffe4c None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:45.109938 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 562/1127] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 27 18:53:44 2022] GET /identity/v3/users/ea872c5b8dd04caf9d53c8100e0e4f61 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:45.116011 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec73a2-65ac-4685-92dc-c01025fdae49 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:45.212432 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec73a2-65ac-4685-92dc-c01025fdae49 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:45.246179 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5885cdf9-5031-4583-a57a-a177e6ec150f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:45.246783 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885cdf9-5031-4583-a57a-a177e6ec150f None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:45.247064 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885cdf9-5031-4583-a57a-a177e6ec150f None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:45.247337 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885cdf9-5031-4583-a57a-a177e6ec150f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:45.267523 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:45.312531 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5885cdf9-5031-4583-a57a-a177e6ec150f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:45.313900 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5885cdf9-5031-4583-a57a-a177e6ec150f None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:45.407294 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 566/1128] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 27 18:53:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 18:53:45.413910 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41675799-e681-443d-adf4-ad17549ffe4c None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:45.515349 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41675799-e681-443d-adf4-ad17549ffe4c None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:45.549840 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f98842-edb4-49a7-9e08-4296177aef64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:45.550473 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f98842-edb4-49a7-9e08-4296177aef64 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:45.550754 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f98842-edb4-49a7-9e08-4296177aef64 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:45.551026 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f98842-edb4-49a7-9e08-4296177aef64 None admin] PATH_INFO: `/v3/projects/5aaf9fa526ca4cfea8785c89cef83d07` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:45.552241 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f98842-edb4-49a7-9e08-4296177aef64 None admin] RBAC: Authorizing `identity:get_project(project_id=5aaf9fa526ca4cfea8785c89cef83d07)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:45.553666 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f98842-edb4-49a7-9e08-4296177aef64 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:45.555324 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 563/1129] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 27 18:53:45 2022] GET /identity/v3/projects/5aaf9fa526ca4cfea8785c89cef83d07 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:45.561410 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5885cdf9-5031-4583-a57a-a177e6ec150f None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:45.611704 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:45.656544 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5885cdf9-5031-4583-a57a-a177e6ec150f None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:45.689091 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a94073b-3f91-4cd2-807f-64f84165f923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:45.689682 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94073b-3f91-4cd2-807f-64f84165f923 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:45.689958 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94073b-3f91-4cd2-807f-64f84165f923 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:45.690227 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94073b-3f91-4cd2-807f-64f84165f923 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:45.690991 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a94073b-3f91-4cd2-807f-64f84165f923 None admin] RBAC: Adding query filter params (role.id=8d808722e03a4591a59440f170ec672f, scope.project.id=5aaf9fa526ca4cfea8785c89cef83d07, user.id=ea872c5b8dd04caf9d53c8100e0e4f61) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:45.691297 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a94073b-3f91-4cd2-807f-64f84165f923 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:45.692748 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a94073b-3f91-4cd2-807f-64f84165f923 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:45.698314 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 567/1130] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 27 18:53:45 2022] GET /identity/v3/role_assignments?user.id=ea872c5b8dd04caf9d53c8100e0e4f61&scope.project.id=5aaf9fa526ca4cfea8785c89cef83d07&role.id=8d808722e03a4591a59440f170ec672f => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:47.698493 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47da40d-59f9-4b54-9328-6dd2f187873d None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:47.699031 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47da40d-59f9-4b54-9328-6dd2f187873d None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:47.699031 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47da40d-59f9-4b54-9328-6dd2f187873d None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:47.700441 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 564/1131] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:53:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:53:47.705454 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b516ed-87d2-4173-8ef4-0e49f372313a None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:47.705852 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b516ed-87d2-4173-8ef4-0e49f372313a None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:47.705996 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b516ed-87d2-4173-8ef4-0e49f372313a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:47.724765 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-e2b516ed-87d2-4173-8ef4-0e49f372313a None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:53:47.725918 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-e2b516ed-87d2-4173-8ef4-0e49f372313a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:47.789546 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 568/1132] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:53:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:53:47.811461 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47da40d-59f9-4b54-9328-6dd2f187873d None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:47.836182 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:47.915182 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47da40d-59f9-4b54-9328-6dd2f187873d None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:47.961837 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580da7a1-c93c-4ee9-8d36-5732715d8dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:47.962759 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580da7a1-c93c-4ee9-8d36-5732715d8dae None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:47.963175 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580da7a1-c93c-4ee9-8d36-5732715d8dae None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:47.963585 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580da7a1-c93c-4ee9-8d36-5732715d8dae None admin] PATH_INFO: `/v3/domains/default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:47.965368 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580da7a1-c93c-4ee9-8d36-5732715d8dae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:47.967218 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580da7a1-c93c-4ee9-8d36-5732715d8dae None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:47.969728 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 565/1133] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:53:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:47.976254 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b516ed-87d2-4173-8ef4-0e49f372313a None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:48.019676 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:48.071415 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b516ed-87d2-4173-8ef4-0e49f372313a None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:48.104875 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10fd7d6-2efe-4786-a101-4f2bddcf2e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:48.105473 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10fd7d6-2efe-4786-a101-4f2bddcf2e31 None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:48.105754 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10fd7d6-2efe-4786-a101-4f2bddcf2e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:48.106030 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10fd7d6-2efe-4786-a101-4f2bddcf2e31 None admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:48.106706 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10fd7d6-2efe-4786-a101-4f2bddcf2e31 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:48.108154 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10fd7d6-2efe-4786-a101-4f2bddcf2e31 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:48.133732 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 569/1134] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Jul 27 18:53:47 2022] POST /identity/v3/projects => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:53:50.137434 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1e890-5cc9-4b38-a7a8-c00e4c4ce73c None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:50.137968 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1e890-5cc9-4b38-a7a8-c00e4c4ce73c None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:50.137968 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1e890-5cc9-4b38-a7a8-c00e4c4ce73c None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:50.139331 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 566/1135] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:53:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:53:50.144592 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ee84f-fffd-4d68-a6ae-d6bf7dc671d8 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:50.145018 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ee84f-fffd-4d68-a6ae-d6bf7dc671d8 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:50.145141 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ee84f-fffd-4d68-a6ae-d6bf7dc671d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:50.162749 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-9c7ee84f-fffd-4d68-a6ae-d6bf7dc671d8 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:53:50.163946 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-9c7ee84f-fffd-4d68-a6ae-d6bf7dc671d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:50.228250 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 570/1136] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:53:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:53:50.253564 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd1e890-5cc9-4b38-a7a8-c00e4c4ce73c None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:50.341616 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:50.351336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd1e890-5cc9-4b38-a7a8-c00e4c4ce73c None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:50.384511 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3305eb40-7732-4f7a-bdeb-2d1c6893c985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:50.385130 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305eb40-7732-4f7a-bdeb-2d1c6893c985 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:50.385411 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305eb40-7732-4f7a-bdeb-2d1c6893c985 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:50.385682 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305eb40-7732-4f7a-bdeb-2d1c6893c985 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:50.386806 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3305eb40-7732-4f7a-bdeb-2d1c6893c985 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:50.388303 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3305eb40-7732-4f7a-bdeb-2d1c6893c985 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:50.389808 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 567/1137] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:53:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:50.395484 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ee84f-fffd-4d68-a6ae-d6bf7dc671d8 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:50.422266 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:50.492396 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ee84f-fffd-4d68-a6ae-d6bf7dc671d8 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:50.524845 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487842cf-dfce-4d01-8380-63e3729bc1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:50.525457 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487842cf-dfce-4d01-8380-63e3729bc1ea None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:50.525738 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487842cf-dfce-4d01-8380-63e3729bc1ea None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:50.526014 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487842cf-dfce-4d01-8380-63e3729bc1ea None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:50.526691 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487842cf-dfce-4d01-8380-63e3729bc1ea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:50.528146 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487842cf-dfce-4d01-8380-63e3729bc1ea None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:50.549267 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 571/1138] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Jul 27 18:53:50 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:53:52.580000 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b33d7-f0ec-48e6-86bc-729d56c7e875 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:52.580459 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b33d7-f0ec-48e6-86bc-729d56c7e875 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:52.580557 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b33d7-f0ec-48e6-86bc-729d56c7e875 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:52.581900 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 568/1139] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:53:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:53:52.587278 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ab9c9-dad1-4176-939b-a7abf9483d47 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:52.587662 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ab9c9-dad1-4176-939b-a7abf9483d47 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:52.587930 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ab9c9-dad1-4176-939b-a7abf9483d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:52.605394 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-d47ab9c9-dad1-4176-939b-a7abf9483d47 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:53:52.606570 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-d47ab9c9-dad1-4176-939b-a7abf9483d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:52.673183 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 572/1140] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:53:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:53:52.697542 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b33d7-f0ec-48e6-86bc-729d56c7e875 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:52.794718 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b33d7-f0ec-48e6-86bc-729d56c7e875 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:52.827390 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f55e05-7401-463d-a03b-8080cca5eef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:52.828038 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f55e05-7401-463d-a03b-8080cca5eef4 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:52.828323 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f55e05-7401-463d-a03b-8080cca5eef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:52.828597 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f55e05-7401-463d-a03b-8080cca5eef4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:52.839114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f55e05-7401-463d-a03b-8080cca5eef4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:53:52.844016 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-b8f55e05-7401-463d-a03b-8080cca5eef4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:53:52.844016 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:52.844016 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:52.844016 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:52.844016 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:52.844016 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:52.844016 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:52.844016 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:52.844016 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:52.844016 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:52.844016 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:52.844016 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:52.844016 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:53:52.844016 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:53:52.844016 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:53:52.844016 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:53:52.845178 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:53:52.845178 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:53:52.845178 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:53:52.845178 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:53:52.845178 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:52.845178 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:52.845178 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:52.845178 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:52.845178 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:52.845178 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:52.845178 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:52.845178 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:52.845178 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:52.845178 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:52.845178 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:52.845178 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:52.846255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:52.846255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:52.846255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:52.846255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:52.846255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:53:52.846255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:53:52.846255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:53:52.846255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:53:52.846255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:53:52.846255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:53:52.846255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:53:52.846255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:53:52.846255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 569/1141] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 27 18:53:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:53:52.851012 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ab9c9-dad1-4176-939b-a7abf9483d47 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:52.865888 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:52.954769 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ab9c9-dad1-4176-939b-a7abf9483d47 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:52.988860 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc08c8c3-5595-477f-8be9-b13a20d8a392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:52.989468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc08c8c3-5595-477f-8be9-b13a20d8a392 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:52.989750 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc08c8c3-5595-477f-8be9-b13a20d8a392 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:52.990022 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc08c8c3-5595-477f-8be9-b13a20d8a392 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:52.990729 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc08c8c3-5595-477f-8be9-b13a20d8a392 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:52.991035 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc08c8c3-5595-477f-8be9-b13a20d8a392 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:52.992408 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc08c8c3-5595-477f-8be9-b13a20d8a392 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:53.000202 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 573/1142] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 27 18:53:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:53.005958 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f55e05-7401-463d-a03b-8080cca5eef4 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:53.027564 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:53.102014 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f55e05-7401-463d-a03b-8080cca5eef4 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:53.133715 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c0e8a-acb9-403a-8cb6-51864a327ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:53.134336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c0e8a-acb9-403a-8cb6-51864a327ca4 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:53.134615 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c0e8a-acb9-403a-8cb6-51864a327ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:53.134886 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c0e8a-acb9-403a-8cb6-51864a327ca4 None admin] PATH_INFO: `/v3/users/b825ef18089f4a3a9a359ae6c3cb7a2a` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:53.148008 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545c0e8a-acb9-403a-8cb6-51864a327ca4 None admin] RBAC: Authorizing `identity:get_user(user_id=b825ef18089f4a3a9a359ae6c3cb7a2a)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:53.149425 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545c0e8a-acb9-403a-8cb6-51864a327ca4 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:53.151006 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 570/1143] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 27 18:53:53 2022] GET /identity/v3/users/b825ef18089f4a3a9a359ae6c3cb7a2a => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:53.156530 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc08c8c3-5595-477f-8be9-b13a20d8a392 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:53.232596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:53.254839 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc08c8c3-5595-477f-8be9-b13a20d8a392 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:53.287775 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3717aafe-087d-4821-9f48-30a8eefa562c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:53.288371 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3717aafe-087d-4821-9f48-30a8eefa562c None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:53.288654 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3717aafe-087d-4821-9f48-30a8eefa562c None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:53.288927 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3717aafe-087d-4821-9f48-30a8eefa562c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:53.353643 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3717aafe-087d-4821-9f48-30a8eefa562c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:53.355013 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3717aafe-087d-4821-9f48-30a8eefa562c None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:53.426521 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:53.450601 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 574/1144] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 27 18:53:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 18:53:53.456469 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c0e8a-acb9-403a-8cb6-51864a327ca4 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:53.532297 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:53.553530 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c0e8a-acb9-403a-8cb6-51864a327ca4 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:53.586789 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab61cea-96ae-4e22-a303-6f4e3678f17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:53.587417 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab61cea-96ae-4e22-a303-6f4e3678f17c None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:53.587707 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab61cea-96ae-4e22-a303-6f4e3678f17c None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:53.588037 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab61cea-96ae-4e22-a303-6f4e3678f17c None admin] PATH_INFO: `/v3/projects/7775ba781e294bf2a2be272c33b5ed67` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:53.589184 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab61cea-96ae-4e22-a303-6f4e3678f17c None admin] RBAC: Authorizing `identity:get_project(project_id=7775ba781e294bf2a2be272c33b5ed67)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:53.590599 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab61cea-96ae-4e22-a303-6f4e3678f17c None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:53.592278 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 571/1145] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 27 18:53:53 2022] GET /identity/v3/projects/7775ba781e294bf2a2be272c33b5ed67 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:53.598351 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3717aafe-087d-4821-9f48-30a8eefa562c None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:53.693826 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3717aafe-087d-4821-9f48-30a8eefa562c None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:53.726378 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f590e0ee-9840-4985-b39a-0f084c58ade2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:53.726971 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590e0ee-9840-4985-b39a-0f084c58ade2 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:53.727247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590e0ee-9840-4985-b39a-0f084c58ade2 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:53.727542 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590e0ee-9840-4985-b39a-0f084c58ade2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:53.728376 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f590e0ee-9840-4985-b39a-0f084c58ade2 None admin] RBAC: Adding query filter params (role.id=0f4a39b061e148418413cfe647af9a34, scope.project.id=7775ba781e294bf2a2be272c33b5ed67, user.id=b825ef18089f4a3a9a359ae6c3cb7a2a) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:53.728683 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f590e0ee-9840-4985-b39a-0f084c58ade2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:53.730071 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f590e0ee-9840-4985-b39a-0f084c58ade2 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:53.735456 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 575/1146] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 27 18:53:53 2022] GET /identity/v3/role_assignments?user.id=b825ef18089f4a3a9a359ae6c3cb7a2a&scope.project.id=7775ba781e294bf2a2be272c33b5ed67&role.id=0f4a39b061e148418413cfe647af9a34 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:55.710368 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee330166-a5af-4a50-aab6-2cdf5f5a2005 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:55.710913 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee330166-a5af-4a50-aab6-2cdf5f5a2005 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:55.710913 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee330166-a5af-4a50-aab6-2cdf5f5a2005 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:55.712285 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 572/1147] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:53:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:53:55.717421 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6afe2a5-95cf-422c-9244-3d93d3d6c5ff None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:55.717815 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6afe2a5-95cf-422c-9244-3d93d3d6c5ff None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:55.717976 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6afe2a5-95cf-422c-9244-3d93d3d6c5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:55.736319 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-e6afe2a5-95cf-422c-9244-3d93d3d6c5ff None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:53:55.737472 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-e6afe2a5-95cf-422c-9244-3d93d3d6c5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:55.770702 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:55.803510 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 576/1148] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:53:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:53:55.825613 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee330166-a5af-4a50-aab6-2cdf5f5a2005 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:55.925070 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee330166-a5af-4a50-aab6-2cdf5f5a2005 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:55.957280 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4a3ca8-cd72-4642-92ff-624e9cbdce1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:55.957900 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a3ca8-cd72-4642-92ff-624e9cbdce1c None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:55.958180 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a3ca8-cd72-4642-92ff-624e9cbdce1c None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:55.958451 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a3ca8-cd72-4642-92ff-624e9cbdce1c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:55.968110 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4a3ca8-cd72-4642-92ff-624e9cbdce1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:53:55.973508 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-8c4a3ca8-cd72-4642-92ff-624e9cbdce1c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:53:55.973508 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:55.973508 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:55.973508 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:55.973508 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:55.973508 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:55.973508 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:55.973508 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:55.973508 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:55.973508 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:55.973508 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:55.973508 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:55.973508 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:53:55.973508 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:53:55.973508 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:53:55.973508 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:53:55.974596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:53:55.974596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:53:55.974596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:53:55.974596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:53:55.974596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:55.974596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:55.974596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:55.974596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:55.974596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:55.974596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:55.974596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:55.974596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:55.974596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:55.974596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:55.974596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:55.974596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:55.975614 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:55.975614 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:55.975614 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:55.975614 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:55.975614 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:53:55.975614 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:53:55.975614 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:53:55.975614 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:53:55.975614 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:53:55.975614 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:53:55.975614 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:53:55.975614 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:53:55.975614 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 573/1149] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 27 18:53:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:53:55.980522 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6afe2a5-95cf-422c-9244-3d93d3d6c5ff None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:56.075416 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6afe2a5-95cf-422c-9244-3d93d3d6c5ff None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:56.108552 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d1c0d-437c-470b-8eda-4d91c0b9be8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:56.109414 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d1c0d-437c-470b-8eda-4d91c0b9be8e None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:56.109698 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d1c0d-437c-470b-8eda-4d91c0b9be8e None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:56.109974 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d1c0d-437c-470b-8eda-4d91c0b9be8e None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:56.110684 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52d1c0d-437c-470b-8eda-4d91c0b9be8e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:56.110992 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52d1c0d-437c-470b-8eda-4d91c0b9be8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:56.112369 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52d1c0d-437c-470b-8eda-4d91c0b9be8e None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:56.120160 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 577/1150] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 27 18:53:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:56.125635 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4a3ca8-cd72-4642-92ff-624e9cbdce1c None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:56.134502 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:56.223995 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4a3ca8-cd72-4642-92ff-624e9cbdce1c None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:56.256379 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0a6f4-0fbb-4fe1-b243-8a9c33a1759b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:56.257001 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0a6f4-0fbb-4fe1-b243-8a9c33a1759b None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:56.257284 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0a6f4-0fbb-4fe1-b243-8a9c33a1759b None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:56.257557 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0a6f4-0fbb-4fe1-b243-8a9c33a1759b None admin] PATH_INFO: `/v3/users/b825ef18089f4a3a9a359ae6c3cb7a2a` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:56.258727 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea0a6f4-0fbb-4fe1-b243-8a9c33a1759b None admin] RBAC: Authorizing `identity:get_user(user_id=b825ef18089f4a3a9a359ae6c3cb7a2a)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:56.260243 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea0a6f4-0fbb-4fe1-b243-8a9c33a1759b None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:56.263000 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 574/1151] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 27 18:53:56 2022] GET /identity/v3/users/b825ef18089f4a3a9a359ae6c3cb7a2a => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:56.272508 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d1c0d-437c-470b-8eda-4d91c0b9be8e None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:56.304248 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:56.372549 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d1c0d-437c-470b-8eda-4d91c0b9be8e None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:56.405232 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d25e8b-4ef0-462c-869f-98bd14a80458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:56.405859 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d25e8b-4ef0-462c-869f-98bd14a80458 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:56.406140 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d25e8b-4ef0-462c-869f-98bd14a80458 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:56.406414 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d25e8b-4ef0-462c-869f-98bd14a80458 None admin] PATH_INFO: `/v3/projects/7775ba781e294bf2a2be272c33b5ed67` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:56.407544 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d25e8b-4ef0-462c-869f-98bd14a80458 None admin] RBAC: Authorizing `identity:get_project(project_id=7775ba781e294bf2a2be272c33b5ed67)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:56.408988 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d25e8b-4ef0-462c-869f-98bd14a80458 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:56.410617 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 578/1152] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 27 18:53:56 2022] GET /identity/v3/projects/7775ba781e294bf2a2be272c33b5ed67 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:56.416667 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0a6f4-0fbb-4fe1-b243-8a9c33a1759b None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:56.488169 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:56.512708 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0a6f4-0fbb-4fe1-b243-8a9c33a1759b None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:56.545790 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e95933-850a-43fb-bb9c-a14df70e80f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:56.546445 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e95933-850a-43fb-bb9c-a14df70e80f1 None admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:56.546729 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e95933-850a-43fb-bb9c-a14df70e80f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:56.547001 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e95933-850a-43fb-bb9c-a14df70e80f1 None admin] PATH_INFO: `/v3/projects/7775ba781e294bf2a2be272c33b5ed67/users/b825ef18089f4a3a9a359ae6c3cb7a2a/roles/0f4a39b061e148418413cfe647af9a34` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:56.548922 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e95933-850a-43fb-bb9c-a14df70e80f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=7775ba781e294bf2a2be272c33b5ed67, user_id=b825ef18089f4a3a9a359ae6c3cb7a2a, role_id=0f4a39b061e148418413cfe647af9a34)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:56.550336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e95933-850a-43fb-bb9c-a14df70e80f1 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:56.562669 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 575/1153] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 27 18:53:56 2022] PUT /identity/v3/projects/7775ba781e294bf2a2be272c33b5ed67/users/b825ef18089f4a3a9a359ae6c3cb7a2a/roles/0f4a39b061e148418413cfe647af9a34 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:53:58.537880 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755dd8e-4914-4f1e-94f5-c78abe5971d2 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:58.538282 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755dd8e-4914-4f1e-94f5-c78abe5971d2 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:58.538432 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755dd8e-4914-4f1e-94f5-c78abe5971d2 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:58.539812 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 579/1154] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:53:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:53:58.545130 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62b007-56f3-4930-864b-42ea24708512 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:58.545562 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62b007-56f3-4930-864b-42ea24708512 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:58.545656 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62b007-56f3-4930-864b-42ea24708512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:58.563522 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-4c62b007-56f3-4930-864b-42ea24708512 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:53:58.564713 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-4c62b007-56f3-4930-864b-42ea24708512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:53:58.629108 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 576/1155] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:53:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 18:53:58.651259 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755dd8e-4914-4f1e-94f5-c78abe5971d2 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:58.747404 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:58.751413 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755dd8e-4914-4f1e-94f5-c78abe5971d2 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:58.783141 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f4ccba-2b25-4a5c-a381-9ab669bf6146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:58.783711 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4ccba-2b25-4a5c-a381-9ab669bf6146 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:58.783999 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4ccba-2b25-4a5c-a381-9ab669bf6146 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:58.784266 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4ccba-2b25-4a5c-a381-9ab669bf6146 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:58.794771 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f4ccba-2b25-4a5c-a381-9ab669bf6146 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:53:58.799503 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-f9f4ccba-2b25-4a5c-a381-9ab669bf6146 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:53:58.799503 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:53:58.799503 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:53:58.799503 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:53:58.799503 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:53:58.799503 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:53:58.799503 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:53:58.799503 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:53:58.799503 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:53:58.799503 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:53:58.799503 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:53:58.799503 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:53:58.799503 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:53:58.799503 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:53:58.799503 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:53:58.799503 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:53:58.801134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:53:58.801134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:53:58.801134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:53:58.801134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:53:58.801134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:53:58.801134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:53:58.801134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:53:58.801134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:53:58.801134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:53:58.801134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:53:58.801134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:53:58.801134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:53:58.801134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:53:58.801134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:53:58.801134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:53:58.801134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:53:58.801998 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:53:58.801998 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:53:58.801998 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:53:58.801998 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:53:58.801998 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:53:58.801998 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:53:58.801998 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:53:58.801998 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:53:58.801998 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:53:58.801998 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:53:58.801998 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:53:58.801998 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:53:58.801998 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 580/1156] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 27 18:53:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:53:58.807187 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c62b007-56f3-4930-864b-42ea24708512 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:58.866360 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:58.902162 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c62b007-56f3-4930-864b-42ea24708512 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:58.935375 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c7dea0-1172-4e08-a01b-46a424656b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:58.936000 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7dea0-1172-4e08-a01b-46a424656b70 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:58.936282 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7dea0-1172-4e08-a01b-46a424656b70 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:58.936555 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7dea0-1172-4e08-a01b-46a424656b70 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:58.937262 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c7dea0-1172-4e08-a01b-46a424656b70 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:58.937565 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c7dea0-1172-4e08-a01b-46a424656b70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:58.938919 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c7dea0-1172-4e08-a01b-46a424656b70 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:58.946725 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 577/1157] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 27 18:53:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:58.952377 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f4ccba-2b25-4a5c-a381-9ab669bf6146 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:59.049756 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f4ccba-2b25-4a5c-a381-9ab669bf6146 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:59.081306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5105bffa-bf03-40cd-82f6-8c3761c11158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:59.082453 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105bffa-bf03-40cd-82f6-8c3761c11158 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:59.082731 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105bffa-bf03-40cd-82f6-8c3761c11158 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:59.083000 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105bffa-bf03-40cd-82f6-8c3761c11158 None admin] PATH_INFO: `/v3/users/b825ef18089f4a3a9a359ae6c3cb7a2a` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:59.084158 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5105bffa-bf03-40cd-82f6-8c3761c11158 None admin] RBAC: Authorizing `identity:get_user(user_id=b825ef18089f4a3a9a359ae6c3cb7a2a)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:59.085561 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5105bffa-bf03-40cd-82f6-8c3761c11158 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:59.087126 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 581/1158] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 27 18:53:58 2022] GET /identity/v3/users/b825ef18089f4a3a9a359ae6c3cb7a2a => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:59.092957 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c7dea0-1172-4e08-a01b-46a424656b70 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:59.187233 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c7dea0-1172-4e08-a01b-46a424656b70 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:59.210917 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:59.219288 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df2afb-f821-46b0-ae75-bc716d4866f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:59.219907 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df2afb-f821-46b0-ae75-bc716d4866f0 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:59.220185 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df2afb-f821-46b0-ae75-bc716d4866f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:59.220451 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df2afb-f821-46b0-ae75-bc716d4866f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:59.284282 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5df2afb-f821-46b0-ae75-bc716d4866f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:59.286291 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5df2afb-f821-46b0-ae75-bc716d4866f0 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:59.381563 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 578/1159] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 27 18:53:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 18:53:59.387290 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5105bffa-bf03-40cd-82f6-8c3761c11158 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:59.416041 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:59.484118 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5105bffa-bf03-40cd-82f6-8c3761c11158 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:59.515927 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8770761f-79e0-417c-b5ad-fc7869e5c1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:59.516542 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770761f-79e0-417c-b5ad-fc7869e5c1e9 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:59.516817 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770761f-79e0-417c-b5ad-fc7869e5c1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:59.517087 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770761f-79e0-417c-b5ad-fc7869e5c1e9 None admin] PATH_INFO: `/v3/projects/7775ba781e294bf2a2be272c33b5ed67` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:59.518207 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8770761f-79e0-417c-b5ad-fc7869e5c1e9 None admin] RBAC: Authorizing `identity:get_project(project_id=7775ba781e294bf2a2be272c33b5ed67)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:59.520223 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8770761f-79e0-417c-b5ad-fc7869e5c1e9 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:59.521862 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 582/1160] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 27 18:53:59 2022] GET /identity/v3/projects/7775ba781e294bf2a2be272c33b5ed67 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:53:59.528127 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df2afb-f821-46b0-ae75-bc716d4866f0 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:53:59.554241 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:59.624308 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df2afb-f821-46b0-ae75-bc716d4866f0 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:53:59.657571 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db3b51b-81a7-427d-a6d6-51b0a567030c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:53:59.658112 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3b51b-81a7-427d-a6d6-51b0a567030c None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:53:59.658394 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3b51b-81a7-427d-a6d6-51b0a567030c None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:53:59.658669 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3b51b-81a7-427d-a6d6-51b0a567030c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:53:59.659451 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db3b51b-81a7-427d-a6d6-51b0a567030c None admin] RBAC: Adding query filter params (role.id=0f4a39b061e148418413cfe647af9a34, scope.project.id=7775ba781e294bf2a2be272c33b5ed67, user.id=b825ef18089f4a3a9a359ae6c3cb7a2a) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:53:59.659850 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db3b51b-81a7-427d-a6d6-51b0a567030c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:53:59.661261 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db3b51b-81a7-427d-a6d6-51b0a567030c None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:53:59.666845 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 579/1161] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 27 18:53:59 2022] GET /identity/v3/role_assignments?user.id=b825ef18089f4a3a9a359ae6c3cb7a2a&scope.project.id=7775ba781e294bf2a2be272c33b5ed67&role.id=0f4a39b061e148418413cfe647af9a34 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:54:01.640754 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34fabd7-4b0e-47c1-9281-292125c850a4 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:54:01.641302 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34fabd7-4b0e-47c1-9281-292125c850a4 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:54:01.641302 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34fabd7-4b0e-47c1-9281-292125c850a4 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:54:01.643148 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 583/1162] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:54:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:54:01.649132 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cec4bf-4bc1-4ed7-bf7b-67c2afb1b29e None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:54:01.649560 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cec4bf-4bc1-4ed7-bf7b-67c2afb1b29e None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:54:01.649689 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cec4bf-4bc1-4ed7-bf7b-67c2afb1b29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:54:01.667119 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-57cec4bf-4bc1-4ed7-bf7b-67c2afb1b29e None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:54:01.668336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-57cec4bf-4bc1-4ed7-bf7b-67c2afb1b29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:54:01.733031 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 580/1163] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:54:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:54:01.755674 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34fabd7-4b0e-47c1-9281-292125c850a4 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:54:01.847456 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:54:01.854160 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34fabd7-4b0e-47c1-9281-292125c850a4 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:54:01.886664 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c62d7c2-bec2-493f-b54e-f2644c8c20a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:54:01.887264 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62d7c2-bec2-493f-b54e-f2644c8c20a1 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:54:01.887543 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62d7c2-bec2-493f-b54e-f2644c8c20a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:54:01.887844 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62d7c2-bec2-493f-b54e-f2644c8c20a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:54:01.951566 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c62d7c2-bec2-493f-b54e-f2644c8c20a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:54:01.953007 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c62d7c2-bec2-493f-b54e-f2644c8c20a1 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:54:02.052137 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:54:02.059567 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 584/1164] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 27 18:54:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 18:54:02.065715 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cec4bf-4bc1-4ed7-bf7b-67c2afb1b29e None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:54:02.086424 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:54:02.165830 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cec4bf-4bc1-4ed7-bf7b-67c2afb1b29e None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:54:02.199859 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c9257-d9a2-4ab5-8ac7-07882e4509ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:54:02.200483 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c9257-d9a2-4ab5-8ac7-07882e4509ba None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:54:02.200761 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c9257-d9a2-4ab5-8ac7-07882e4509ba None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:54:02.201031 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c9257-d9a2-4ab5-8ac7-07882e4509ba None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:54:02.207501 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14c9257-d9a2-4ab5-8ac7-07882e4509ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:54:02.208966 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14c9257-d9a2-4ab5-8ac7-07882e4509ba None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:54:02.220810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-a14c9257-d9a2-4ab5-8ac7-07882e4509ba None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 27 18:54:02.220810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:54:02.220810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 27 18:54:02.220810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 27 18:54:02.220810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:54:02.220810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:54:02.220810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:54:02.220810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:54:02.220810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 27 18:54:02.220810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:54:02.220810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:54:02.220810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:54:02.220810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:54:02.220810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:54:02.220810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:54:02.220810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:54:02.220810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:54:02.222014 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:54:02.222014 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:54:02.222014 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:54:02.222014 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:54:02.222014 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:54:02.222014 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:54:02.222014 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:54:02.222014 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:54:02.222014 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:54:02.222014 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:54:02.222014 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:54:02.222014 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:54:02.222014 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:54:02.222014 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:54:02.222014 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:54:02.222014 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:54:02.222875 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:54:02.222875 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:54:02.222875 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:54:02.222875 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:54:02.222875 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:54:02.222875 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:54:02.222875 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:54:02.222875 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:54:02.222875 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:54:02.222875 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:54:02.222875 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 27 18:54:02.222875 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:54:02.222875 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 27 18:54:02.222875 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:54:02.222875 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 581/1165] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Jul 27 18:54:02 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:54:02.227946 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c62d7c2-bec2-493f-b54e-f2644c8c20a1 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:54:02.323788 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c62d7c2-bec2-493f-b54e-f2644c8c20a1 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:54:02.357909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9953d1-3eec-4ce7-b90e-5c803d0c5173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:54:02.358766 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9953d1-3eec-4ce7-b90e-5c803d0c5173 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:54:02.359042 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9953d1-3eec-4ce7-b90e-5c803d0c5173 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:54:02.359313 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9953d1-3eec-4ce7-b90e-5c803d0c5173 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:54:02.360018 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9953d1-3eec-4ce7-b90e-5c803d0c5173 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:54:02.360320 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9953d1-3eec-4ce7-b90e-5c803d0c5173 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:54:02.361671 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9953d1-3eec-4ce7-b90e-5c803d0c5173 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:54:02.369131 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 585/1166] 10.222.0.20 () {56 vars in 1115 bytes} [Wed Jul 27 18:54:02 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:54:04.325339 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d6fc62-89bd-46d3-b02b-5806d8d2ff93 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:54:04.325933 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d6fc62-89bd-46d3-b02b-5806d8d2ff93 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:54:04.325933 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d6fc62-89bd-46d3-b02b-5806d8d2ff93 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:54:04.327229 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 582/1167] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:54:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:54:04.333097 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f810a-87e6-4d5b-bd67-f290b715ef81 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:54:04.333477 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f810a-87e6-4d5b-bd67-f290b715ef81 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:54:04.333646 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f810a-87e6-4d5b-bd67-f290b715ef81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:54:04.352158 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-fd0f810a-87e6-4d5b-bd67-f290b715ef81 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:54:04.353371 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-fd0f810a-87e6-4d5b-bd67-f290b715ef81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:54:04.407847 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:54:04.419477 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 586/1168] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:54:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:54:04.441946 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d6fc62-89bd-46d3-b02b-5806d8d2ff93 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:54:04.520416 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:54:04.541203 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d6fc62-89bd-46d3-b02b-5806d8d2ff93 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:54:04.576880 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b6134-0580-4e3b-9d57-4060d8c86d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:54:04.577427 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b6134-0580-4e3b-9d57-4060d8c86d74 None admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:54:04.577768 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b6134-0580-4e3b-9d57-4060d8c86d74 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:54:04.578105 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b6134-0580-4e3b-9d57-4060d8c86d74 None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:54:04.578817 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5b6134-0580-4e3b-9d57-4060d8c86d74 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:54:04.580354 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5b6134-0580-4e3b-9d57-4060d8c86d74 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:54:04.596015 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 583/1169] 10.222.0.20 () {60 vars in 1138 bytes} [Wed Jul 27 18:54:04 2022] POST /identity/v3/domains => generated 267 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:54:06.754982 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50afd83-6312-4979-b733-05878ede70db None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:54:06.755531 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50afd83-6312-4979-b733-05878ede70db None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:54:06.755531 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50afd83-6312-4979-b733-05878ede70db None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:54:06.757019 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 587/1170] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:54:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:54:06.762379 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc5e61-6cd4-45b1-b856-62d8618bb9c2 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:54:06.762770 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc5e61-6cd4-45b1-b856-62d8618bb9c2 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:54:06.762997 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc5e61-6cd4-45b1-b856-62d8618bb9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:54:06.787983 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-cbdc5e61-6cd4-45b1-b856-62d8618bb9c2 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:54:06.789161 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-cbdc5e61-6cd4-45b1-b856-62d8618bb9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:54:06.856735 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 584/1171] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:54:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:54:06.881528 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50afd83-6312-4979-b733-05878ede70db None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:54:06.978919 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50afd83-6312-4979-b733-05878ede70db None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:54:07.011365 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca460596-7368-4588-b95f-9755697f067c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:54:07.012012 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca460596-7368-4588-b95f-9755697f067c None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:54:07.012292 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca460596-7368-4588-b95f-9755697f067c None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:54:07.012562 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca460596-7368-4588-b95f-9755697f067c None admin] PATH_INFO: `/v3/domains/d9778c20edcd46c78282d91ea32cda80` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:54:07.023131 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca460596-7368-4588-b95f-9755697f067c None admin] RBAC: Authorizing `identity:get_domain(domain_id=d9778c20edcd46c78282d91ea32cda80)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:54:07.024589 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca460596-7368-4588-b95f-9755697f067c None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:54:07.026162 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 588/1172] 10.222.0.20 () {56 vars in 1183 bytes} [Wed Jul 27 18:54:06 2022] GET /identity/v3/domains/d9778c20edcd46c78282d91ea32cda80 => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:54:07.031888 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc5e61-6cd4-45b1-b856-62d8618bb9c2 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:54:07.099127 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:54:07.129316 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc5e61-6cd4-45b1-b856-62d8618bb9c2 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:54:07.161920 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1434c64c-87d1-4091-b178-9d68b62c0945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:54:07.162520 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434c64c-87d1-4091-b178-9d68b62c0945 None admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:54:07.162797 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434c64c-87d1-4091-b178-9d68b62c0945 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:54:07.163064 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434c64c-87d1-4091-b178-9d68b62c0945 None admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:54:07.163759 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1434c64c-87d1-4091-b178-9d68b62c0945 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:54:07.165167 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1434c64c-87d1-4091-b178-9d68b62c0945 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:54:07.190970 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 585/1173] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Jul 27 18:54:07 2022] POST /identity/v3/projects => generated 361 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:54:09.204368 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f39e5-e73f-4771-b6de-78b5bc1c9bf5 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:54:09.204906 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f39e5-e73f-4771-b6de-78b5bc1c9bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:54:09.204906 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f39e5-e73f-4771-b6de-78b5bc1c9bf5 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:54:09.206236 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 589/1174] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:54:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:54:09.211383 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1435e-122d-45c7-aa6b-675caddf9f9f None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:54:09.211827 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1435e-122d-45c7-aa6b-675caddf9f9f None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:54:09.211983 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1435e-122d-45c7-aa6b-675caddf9f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:54:09.230081 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-7ee1435e-122d-45c7-aa6b-675caddf9f9f None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:54:09.231256 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-7ee1435e-122d-45c7-aa6b-675caddf9f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:54:09.295263 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 586/1175] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:54:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:54:09.319712 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f39e5-e73f-4771-b6de-78b5bc1c9bf5 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:54:09.370002 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:54:09.418894 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f39e5-e73f-4771-b6de-78b5bc1c9bf5 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:54:09.451139 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4945c48a-360f-4e0d-87ba-ca996333e559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:54:09.451786 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945c48a-360f-4e0d-87ba-ca996333e559 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:54:09.452067 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945c48a-360f-4e0d-87ba-ca996333e559 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:54:09.452339 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945c48a-360f-4e0d-87ba-ca996333e559 None admin] PATH_INFO: `/v3/domains/d9778c20edcd46c78282d91ea32cda80` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:54:09.453479 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4945c48a-360f-4e0d-87ba-ca996333e559 None admin] RBAC: Authorizing `identity:get_domain(domain_id=d9778c20edcd46c78282d91ea32cda80)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:54:09.454942 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4945c48a-360f-4e0d-87ba-ca996333e559 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:54:09.456521 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 590/1176] 10.222.0.20 () {56 vars in 1183 bytes} [Wed Jul 27 18:54:09 2022] GET /identity/v3/domains/d9778c20edcd46c78282d91ea32cda80 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:54:09.462250 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee1435e-122d-45c7-aa6b-675caddf9f9f None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:54:09.513339 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:54:09.560388 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee1435e-122d-45c7-aa6b-675caddf9f9f None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:54:09.593338 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c046ab-5ad7-478b-bd0c-422bff8a2ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:54:09.593945 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c046ab-5ad7-478b-bd0c-422bff8a2ed5 None admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:54:09.594227 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c046ab-5ad7-478b-bd0c-422bff8a2ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:54:09.594501 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c046ab-5ad7-478b-bd0c-422bff8a2ed5 None admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:54:09.595189 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c046ab-5ad7-478b-bd0c-422bff8a2ed5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:54:09.597270 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c046ab-5ad7-478b-bd0c-422bff8a2ed5 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:54:09.617523 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 587/1177] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Jul 27 18:54:09 2022] POST /identity/v3/users => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:54:11.639430 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543348d-7b91-428c-8689-71ed20bfacc9 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:54:11.640039 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543348d-7b91-428c-8689-71ed20bfacc9 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:54:11.640039 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543348d-7b91-428c-8689-71ed20bfacc9 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:54:11.641342 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 591/1178] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:54:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:54:11.646664 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b25a28-9683-428b-8b6f-ffe8818b9938 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:54:11.647111 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b25a28-9683-428b-8b6f-ffe8818b9938 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:54:11.647214 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b25a28-9683-428b-8b6f-ffe8818b9938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:54:11.665057 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-16b25a28-9683-428b-8b6f-ffe8818b9938 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:54:11.666210 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-16b25a28-9683-428b-8b6f-ffe8818b9938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:54:11.736974 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 588/1179] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:54:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:54:11.760178 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543348d-7b91-428c-8689-71ed20bfacc9 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:54:11.858798 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543348d-7b91-428c-8689-71ed20bfacc9 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:54:11.874497 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:54:11.890665 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742c1a95-e473-4769-9d05-a3b95f3b30c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:54:11.891281 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c1a95-e473-4769-9d05-a3b95f3b30c3 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:54:11.891558 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c1a95-e473-4769-9d05-a3b95f3b30c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:54:11.891855 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c1a95-e473-4769-9d05-a3b95f3b30c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:54:11.902642 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742c1a95-e473-4769-9d05-a3b95f3b30c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:54:11.907389 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-742c1a95-e473-4769-9d05-a3b95f3b30c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:54:11.907389 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:54:11.907389 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:54:11.907389 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:54:11.907389 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:54:11.907389 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:54:11.907389 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:54:11.907389 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:54:11.907389 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:54:11.907389 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:54:11.907389 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:54:11.907389 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:54:11.907389 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:54:11.907389 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:54:11.907389 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:54:11.907389 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:54:11.908589 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:54:11.908589 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:54:11.908589 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:54:11.908589 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:54:11.908589 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:54:11.908589 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:54:11.908589 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:54:11.908589 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:54:11.908589 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:54:11.908589 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:54:11.908589 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:54:11.908589 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:54:11.908589 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:54:11.908589 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:54:11.908589 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:54:11.908589 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:54:11.910247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:54:11.910247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:54:11.910247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:54:11.910247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:54:11.910247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:54:11.910247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:54:11.910247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:54:11.910247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:54:11.910247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:54:11.910247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:54:11.910247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:54:11.910247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:54:11.910247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 592/1180] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 27 18:54:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:54:11.915235 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b25a28-9683-428b-8b6f-ffe8818b9938 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:54:11.951877 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:54:12.010511 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b25a28-9683-428b-8b6f-ffe8818b9938 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:54:12.043322 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac428e1-ba02-42fa-8499-a0877ef8be6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:54:12.043960 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac428e1-ba02-42fa-8499-a0877ef8be6c None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:54:12.044240 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac428e1-ba02-42fa-8499-a0877ef8be6c None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:54:12.044513 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac428e1-ba02-42fa-8499-a0877ef8be6c None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:54:12.045225 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac428e1-ba02-42fa-8499-a0877ef8be6c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:54:12.045526 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac428e1-ba02-42fa-8499-a0877ef8be6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:54:12.046872 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac428e1-ba02-42fa-8499-a0877ef8be6c None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:54:12.054895 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 589/1181] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 27 18:54:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:54:12.060949 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742c1a95-e473-4769-9d05-a3b95f3b30c3 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:54:12.160920 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742c1a95-e473-4769-9d05-a3b95f3b30c3 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:54:12.193280 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa8b16e-34ae-4868-9be5-41606018ed79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:54:12.193905 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8b16e-34ae-4868-9be5-41606018ed79 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:54:12.194186 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8b16e-34ae-4868-9be5-41606018ed79 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:54:12.194462 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8b16e-34ae-4868-9be5-41606018ed79 None admin] PATH_INFO: `/v3/users/e63af9537f6b4405963eb5ee99d5bee7` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:54:12.207623 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa8b16e-34ae-4868-9be5-41606018ed79 None admin] RBAC: Authorizing `identity:get_user(user_id=e63af9537f6b4405963eb5ee99d5bee7)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:54:12.209070 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa8b16e-34ae-4868-9be5-41606018ed79 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:54:12.210670 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 593/1182] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 27 18:54:12 2022] GET /identity/v3/users/e63af9537f6b4405963eb5ee99d5bee7 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:54:12.216493 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac428e1-ba02-42fa-8499-a0877ef8be6c None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:54:12.309417 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:54:12.312657 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac428e1-ba02-42fa-8499-a0877ef8be6c None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:54:12.346111 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba8767d-1124-4320-9af7-7ed0992228f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:54:12.346712 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8767d-1124-4320-9af7-7ed0992228f5 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:54:12.346993 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8767d-1124-4320-9af7-7ed0992228f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:54:12.347266 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8767d-1124-4320-9af7-7ed0992228f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:54:12.411869 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba8767d-1124-4320-9af7-7ed0992228f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:54:12.413233 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba8767d-1124-4320-9af7-7ed0992228f5 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:54:12.503749 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:54:12.507415 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 590/1183] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 27 18:54:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 18:54:12.513440 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa8b16e-34ae-4868-9be5-41606018ed79 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:54:12.547734 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:54:12.611561 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa8b16e-34ae-4868-9be5-41606018ed79 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:54:12.645354 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e55d16-849f-4878-9360-6adc3df31aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:54:12.645980 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e55d16-849f-4878-9360-6adc3df31aad None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:54:12.646261 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e55d16-849f-4878-9360-6adc3df31aad None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:54:12.646535 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e55d16-849f-4878-9360-6adc3df31aad None admin] PATH_INFO: `/v3/projects/b48d0f5f46fa4451b7fc06e89669a1e5` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:54:12.647680 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e55d16-849f-4878-9360-6adc3df31aad None admin] RBAC: Authorizing `identity:get_project(project_id=b48d0f5f46fa4451b7fc06e89669a1e5)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:54:12.649117 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e55d16-849f-4878-9360-6adc3df31aad None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:54:12.650764 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 594/1184] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 27 18:54:12 2022] GET /identity/v3/projects/b48d0f5f46fa4451b7fc06e89669a1e5 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:54:12.657050 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba8767d-1124-4320-9af7-7ed0992228f5 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:54:12.752220 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba8767d-1124-4320-9af7-7ed0992228f5 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:54:12.785214 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b78b7-bb60-4947-861b-bdf6167beb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:54:12.785805 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b78b7-bb60-4947-861b-bdf6167beb18 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:54:12.786082 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b78b7-bb60-4947-861b-bdf6167beb18 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:54:12.786352 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b78b7-bb60-4947-861b-bdf6167beb18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:54:12.787128 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571b78b7-bb60-4947-861b-bdf6167beb18 None admin] RBAC: Adding query filter params (role.id=0f4a39b061e148418413cfe647af9a34, scope.project.id=b48d0f5f46fa4451b7fc06e89669a1e5, user.id=e63af9537f6b4405963eb5ee99d5bee7) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:54:12.787435 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571b78b7-bb60-4947-861b-bdf6167beb18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:54:12.788874 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571b78b7-bb60-4947-861b-bdf6167beb18 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:54:12.794036 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 591/1185] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 27 18:54:12 2022] GET /identity/v3/role_assignments?user.id=e63af9537f6b4405963eb5ee99d5bee7&scope.project.id=b48d0f5f46fa4451b7fc06e89669a1e5&role.id=0f4a39b061e148418413cfe647af9a34 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:54:14.764892 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ab4e5-e66e-445e-bb6d-9f483685e71f None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:54:14.765409 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ab4e5-e66e-445e-bb6d-9f483685e71f None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:54:14.765520 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ab4e5-e66e-445e-bb6d-9f483685e71f None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:54:14.766809 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 595/1186] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:54:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:54:14.772376 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34db3f3-74ee-44cc-801e-9eb9b4168247 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:54:14.772804 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34db3f3-74ee-44cc-801e-9eb9b4168247 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:54:14.772905 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34db3f3-74ee-44cc-801e-9eb9b4168247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:54:14.790818 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-e34db3f3-74ee-44cc-801e-9eb9b4168247 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:54:14.791941 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-e34db3f3-74ee-44cc-801e-9eb9b4168247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:54:14.848330 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:54:14.856643 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 592/1187] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:54:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:54:14.878786 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9ab4e5-e66e-445e-bb6d-9f483685e71f None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:54:14.976604 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9ab4e5-e66e-445e-bb6d-9f483685e71f None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:54:14.978834 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:54:15.009651 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7e5bb-8920-409e-827b-505bbca906d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:54:15.010273 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7e5bb-8920-409e-827b-505bbca906d5 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:54:15.010556 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7e5bb-8920-409e-827b-505bbca906d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:54:15.010831 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7e5bb-8920-409e-827b-505bbca906d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:54:15.021197 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a7e5bb-8920-409e-827b-505bbca906d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:54:15.026159 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-e1a7e5bb-8920-409e-827b-505bbca906d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:54:15.026159 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:54:15.026159 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:54:15.026159 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:54:15.026159 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:54:15.026159 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:54:15.026159 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:54:15.026159 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:54:15.026159 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:54:15.026159 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:54:15.026159 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:54:15.026159 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:54:15.026159 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:54:15.026159 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:54:15.026159 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:54:15.026159 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:54:15.027476 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:54:15.027476 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:54:15.027476 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:54:15.027476 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:54:15.027476 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:54:15.027476 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:54:15.027476 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:54:15.027476 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:54:15.027476 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:54:15.027476 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:54:15.027476 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:54:15.027476 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:54:15.027476 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:54:15.027476 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:54:15.027476 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:54:15.027476 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:54:15.028582 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:54:15.028582 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:54:15.028582 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:54:15.028582 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:54:15.028582 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:54:15.028582 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:54:15.028582 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:54:15.028582 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:54:15.028582 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:54:15.028582 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:54:15.028582 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:54:15.028582 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:54:15.028582 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 596/1188] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 27 18:54:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:54:15.033286 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34db3f3-74ee-44cc-801e-9eb9b4168247 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:54:15.129105 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34db3f3-74ee-44cc-801e-9eb9b4168247 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:54:15.162012 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f6e77-be69-417b-9be2-d3310dff0744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:54:15.162607 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f6e77-be69-417b-9be2-d3310dff0744 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:54:15.162886 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f6e77-be69-417b-9be2-d3310dff0744 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:54:15.163158 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f6e77-be69-417b-9be2-d3310dff0744 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:54:15.164006 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6f6e77-be69-417b-9be2-d3310dff0744 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:54:15.164314 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6f6e77-be69-417b-9be2-d3310dff0744 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:54:15.165670 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6f6e77-be69-417b-9be2-d3310dff0744 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:54:15.173392 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 593/1189] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 27 18:54:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:54:15.179111 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7e5bb-8920-409e-827b-505bbca906d5 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:54:15.276338 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7e5bb-8920-409e-827b-505bbca906d5 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:54:15.308122 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b8f417-20f6-4c9a-a8f2-83dfae991409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:54:15.308743 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8f417-20f6-4c9a-a8f2-83dfae991409 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:54:15.309024 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8f417-20f6-4c9a-a8f2-83dfae991409 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:54:15.309296 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8f417-20f6-4c9a-a8f2-83dfae991409 None admin] PATH_INFO: `/v3/users/e63af9537f6b4405963eb5ee99d5bee7` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:54:15.310434 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b8f417-20f6-4c9a-a8f2-83dfae991409 None admin] RBAC: Authorizing `identity:get_user(user_id=e63af9537f6b4405963eb5ee99d5bee7)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:54:15.311883 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b8f417-20f6-4c9a-a8f2-83dfae991409 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:54:15.313449 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 597/1190] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 27 18:54:15 2022] GET /identity/v3/users/e63af9537f6b4405963eb5ee99d5bee7 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:54:15.319763 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f6e77-be69-417b-9be2-d3310dff0744 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:54:15.373407 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:54:15.415515 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f6e77-be69-417b-9be2-d3310dff0744 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:54:15.447297 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e5ac7-9e36-4904-8258-a5c2604b8cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:54:15.447939 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e5ac7-9e36-4904-8258-a5c2604b8cf2 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:54:15.448219 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e5ac7-9e36-4904-8258-a5c2604b8cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:54:15.448491 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e5ac7-9e36-4904-8258-a5c2604b8cf2 None admin] PATH_INFO: `/v3/projects/b48d0f5f46fa4451b7fc06e89669a1e5` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:54:15.449638 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e5ac7-9e36-4904-8258-a5c2604b8cf2 None admin] RBAC: Authorizing `identity:get_project(project_id=b48d0f5f46fa4451b7fc06e89669a1e5)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:54:15.451044 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e5ac7-9e36-4904-8258-a5c2604b8cf2 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:54:15.452685 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 594/1191] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 27 18:54:15 2022] GET /identity/v3/projects/b48d0f5f46fa4451b7fc06e89669a1e5 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:54:15.458984 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b8f417-20f6-4c9a-a8f2-83dfae991409 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:54:15.489360 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:54:15.556052 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b8f417-20f6-4c9a-a8f2-83dfae991409 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:54:15.588710 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65791d0-b5e4-4fbf-b713-246abc626122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:54:15.589366 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65791d0-b5e4-4fbf-b713-246abc626122 None admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:54:15.589650 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65791d0-b5e4-4fbf-b713-246abc626122 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:54:15.589925 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65791d0-b5e4-4fbf-b713-246abc626122 None admin] PATH_INFO: `/v3/projects/b48d0f5f46fa4451b7fc06e89669a1e5/users/e63af9537f6b4405963eb5ee99d5bee7/roles/0f4a39b061e148418413cfe647af9a34` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:54:15.591873 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65791d0-b5e4-4fbf-b713-246abc626122 None admin] RBAC: Authorizing `identity:create_grant(project_id=b48d0f5f46fa4451b7fc06e89669a1e5, user_id=e63af9537f6b4405963eb5ee99d5bee7, role_id=0f4a39b061e148418413cfe647af9a34)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:54:15.593278 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65791d0-b5e4-4fbf-b713-246abc626122 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:54:15.605302 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 598/1192] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 27 18:54:15 2022] PUT /identity/v3/projects/b48d0f5f46fa4451b7fc06e89669a1e5/users/e63af9537f6b4405963eb5ee99d5bee7/roles/0f4a39b061e148418413cfe647af9a34 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:54:17.569715 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6287a69-88ba-4a06-a8f6-4effd6a5c8bb None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:54:17.570177 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6287a69-88ba-4a06-a8f6-4effd6a5c8bb None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:54:17.570267 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6287a69-88ba-4a06-a8f6-4effd6a5c8bb None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:54:17.571603 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 595/1193] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:54:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:54:17.576753 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed00fb-e8e4-4cfd-b082-b63d96849717 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:54:17.577181 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed00fb-e8e4-4cfd-b082-b63d96849717 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:54:17.577313 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed00fb-e8e4-4cfd-b082-b63d96849717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:54:17.595476 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-79ed00fb-e8e4-4cfd-b082-b63d96849717 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:54:17.597203 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-79ed00fb-e8e4-4cfd-b082-b63d96849717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:54:17.661423 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 599/1194] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:54:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:54:17.684965 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6287a69-88ba-4a06-a8f6-4effd6a5c8bb None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:54:17.790380 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6287a69-88ba-4a06-a8f6-4effd6a5c8bb None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:54:17.811887 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:54:17.822245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303de477-d507-4e95-8025-e6ebea665cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:54:17.822871 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303de477-d507-4e95-8025-e6ebea665cf2 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:54:17.823149 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303de477-d507-4e95-8025-e6ebea665cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:54:17.823417 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303de477-d507-4e95-8025-e6ebea665cf2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:54:17.834091 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303de477-d507-4e95-8025-e6ebea665cf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:54:17.838976 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-303de477-d507-4e95-8025-e6ebea665cf2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:54:17.838976 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:54:17.838976 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:54:17.838976 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:54:17.838976 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:54:17.838976 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:54:17.838976 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:54:17.838976 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:54:17.838976 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:54:17.838976 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:54:17.838976 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:54:17.838976 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:54:17.838976 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:54:17.838976 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:54:17.838976 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:54:17.838976 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:54:17.840096 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:54:17.840096 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:54:17.840096 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:54:17.840096 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:54:17.840096 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:54:17.840096 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:54:17.840096 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:54:17.840096 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:54:17.840096 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:54:17.840096 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:54:17.840096 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:54:17.840096 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:54:17.840096 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:54:17.840096 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:54:17.840096 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:54:17.840096 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:54:17.840983 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:54:17.840983 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:54:17.840983 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:54:17.840983 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:54:17.840983 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:54:17.840983 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:54:17.840983 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:54:17.840983 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:54:17.840983 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:54:17.840983 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:54:17.840983 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:54:17.840983 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:54:17.840983 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 596/1195] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 27 18:54:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:54:17.846871 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed00fb-e8e4-4cfd-b082-b63d96849717 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:54:17.870036 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:54:17.942521 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed00fb-e8e4-4cfd-b082-b63d96849717 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:54:17.975092 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04514e4a-1b2f-4a39-b738-ea4971a725ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:54:17.975705 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04514e4a-1b2f-4a39-b738-ea4971a725ae None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:54:17.976003 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04514e4a-1b2f-4a39-b738-ea4971a725ae None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:54:17.976279 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04514e4a-1b2f-4a39-b738-ea4971a725ae None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:54:17.976998 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04514e4a-1b2f-4a39-b738-ea4971a725ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:54:17.977305 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04514e4a-1b2f-4a39-b738-ea4971a725ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:54:17.978657 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04514e4a-1b2f-4a39-b738-ea4971a725ae None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:54:17.987363 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 600/1196] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 27 18:54:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:54:17.992985 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303de477-d507-4e95-8025-e6ebea665cf2 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:54:18.087560 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303de477-d507-4e95-8025-e6ebea665cf2 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:54:18.120398 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6f51d2-d345-4bc1-bae0-cc4f61a2234b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:54:18.121000 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f51d2-d345-4bc1-bae0-cc4f61a2234b None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:54:18.121278 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f51d2-d345-4bc1-bae0-cc4f61a2234b None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:54:18.121549 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f51d2-d345-4bc1-bae0-cc4f61a2234b None admin] PATH_INFO: `/v3/users/e63af9537f6b4405963eb5ee99d5bee7` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:54:18.122681 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6f51d2-d345-4bc1-bae0-cc4f61a2234b None admin] RBAC: Authorizing `identity:get_user(user_id=e63af9537f6b4405963eb5ee99d5bee7)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:54:18.124124 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6f51d2-d345-4bc1-bae0-cc4f61a2234b None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:54:18.125686 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 597/1197] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 27 18:54:17 2022] GET /identity/v3/users/e63af9537f6b4405963eb5ee99d5bee7 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:54:18.131306 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04514e4a-1b2f-4a39-b738-ea4971a725ae None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:54:18.211800 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:54:18.227618 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04514e4a-1b2f-4a39-b738-ea4971a725ae None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:54:18.260198 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd207f2-3a64-4630-89ba-2daa39444ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:54:18.260796 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd207f2-3a64-4630-89ba-2daa39444ea2 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:54:18.261075 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd207f2-3a64-4630-89ba-2daa39444ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:54:18.261349 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd207f2-3a64-4630-89ba-2daa39444ea2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:54:18.326028 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd207f2-3a64-4630-89ba-2daa39444ea2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:54:18.327447 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd207f2-3a64-4630-89ba-2daa39444ea2 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:54:18.405199 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:54:18.421613 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 601/1198] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 27 18:54:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 18:54:18.428024 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6f51d2-d345-4bc1-bae0-cc4f61a2234b None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:54:18.478235 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:54:18.524775 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6f51d2-d345-4bc1-bae0-cc4f61a2234b None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:54:18.557774 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b54e2e-8654-4ac2-bf17-28e70f4324de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:54:18.558401 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b54e2e-8654-4ac2-bf17-28e70f4324de None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:54:18.558685 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b54e2e-8654-4ac2-bf17-28e70f4324de None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:54:18.558961 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b54e2e-8654-4ac2-bf17-28e70f4324de None admin] PATH_INFO: `/v3/projects/b48d0f5f46fa4451b7fc06e89669a1e5` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:54:18.560143 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b54e2e-8654-4ac2-bf17-28e70f4324de None admin] RBAC: Authorizing `identity:get_project(project_id=b48d0f5f46fa4451b7fc06e89669a1e5)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:54:18.561557 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b54e2e-8654-4ac2-bf17-28e70f4324de None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:54:18.563193 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 598/1199] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 27 18:54:18 2022] GET /identity/v3/projects/b48d0f5f46fa4451b7fc06e89669a1e5 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:54:18.569379 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd207f2-3a64-4630-89ba-2daa39444ea2 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:54:18.665124 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd207f2-3a64-4630-89ba-2daa39444ea2 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:54:18.697239 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c56e1a1-9900-46e8-a920-32a75d1e603f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:54:18.697836 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56e1a1-9900-46e8-a920-32a75d1e603f None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:54:18.698116 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56e1a1-9900-46e8-a920-32a75d1e603f None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:54:18.698385 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56e1a1-9900-46e8-a920-32a75d1e603f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:54:18.699164 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c56e1a1-9900-46e8-a920-32a75d1e603f None admin] RBAC: Adding query filter params (role.id=0f4a39b061e148418413cfe647af9a34, scope.project.id=b48d0f5f46fa4451b7fc06e89669a1e5, user.id=e63af9537f6b4405963eb5ee99d5bee7) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:54:18.699480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c56e1a1-9900-46e8-a920-32a75d1e603f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:54:18.700922 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c56e1a1-9900-46e8-a920-32a75d1e603f None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:54:18.707071 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 602/1200] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 27 18:54:18 2022] GET /identity/v3/role_assignments?user.id=e63af9537f6b4405963eb5ee99d5bee7&scope.project.id=b48d0f5f46fa4451b7fc06e89669a1e5&role.id=0f4a39b061e148418413cfe647af9a34 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:54:28.553716 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=40 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:54:28.704015 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=76 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:13.444023 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753d756-ef0e-4457-9dfd-33da390947f0 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:13.444660 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753d756-ef0e-4457-9dfd-33da390947f0 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:13.444660 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753d756-ef0e-4457-9dfd-33da390947f0 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:13.446281 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 599/1201] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:55:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:55:13.452780 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01046532-7ec0-46f9-9c91-564522f6c0b8 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:13.453287 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01046532-7ec0-46f9-9c91-564522f6c0b8 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:13.453374 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01046532-7ec0-46f9-9c91-564522f6c0b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:13.474035 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-01046532-7ec0-46f9-9c91-564522f6c0b8 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:55:13.475358 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-01046532-7ec0-46f9-9c91-564522f6c0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:13.570919 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 603/1202] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:55:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 18:55:13.597888 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5753d756-ef0e-4457-9dfd-33da390947f0 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:13.753569 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5753d756-ef0e-4457-9dfd-33da390947f0 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:13.796351 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc8c92-ecd7-4fe0-9d76-4942188d6641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:13.797017 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc8c92-ecd7-4fe0-9d76-4942188d6641 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:13.797291 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc8c92-ecd7-4fe0-9d76-4942188d6641 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:13.797560 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc8c92-ecd7-4fe0-9d76-4942188d6641 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:13.810379 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cc8c92-ecd7-4fe0-9d76-4942188d6641 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:13.812898 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cc8c92-ecd7-4fe0-9d76-4942188d6641 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:13.830769 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-c8cc8c92-ecd7-4fe0-9d76-4942188d6641 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:55:13.830769 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:55:13.830769 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:55:13.830769 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:55:13.830769 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:55:13.830769 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:55:13.830769 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:55:13.830769 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:55:13.830769 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:55:13.830769 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:55:13.830769 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:55:13.830769 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:55:13.830769 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:55:13.830769 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:55:13.830769 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:55:13.837262 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:55:13.837262 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:55:13.837262 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:55:13.837262 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:55:13.837262 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:55:13.837262 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:55:13.837262 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:55:13.837262 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:55:13.837262 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:55:13.837262 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:55:13.837262 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:55:13.837262 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:55:13.837262 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:55:13.837262 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:55:13.837262 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:55:13.837262 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:55:13.837262 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:55:13.838519 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:55:13.838519 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:55:13.838519 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:55:13.838519 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:55:13.838519 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 600/1203] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:55:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:55:13.838844 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01046532-7ec0-46f9-9c91-564522f6c0b8 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:13.963029 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01046532-7ec0-46f9-9c91-564522f6c0b8 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:13.999135 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:14.008283 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4003e17-5e12-423b-b1d6-551c9dfbd420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:14.008898 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4003e17-5e12-423b-b1d6-551c9dfbd420 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:14.009142 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4003e17-5e12-423b-b1d6-551c9dfbd420 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:14.009471 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4003e17-5e12-423b-b1d6-551c9dfbd420 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:14.010216 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4003e17-5e12-423b-b1d6-551c9dfbd420 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:55:14.010656 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4003e17-5e12-423b-b1d6-551c9dfbd420 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:14.012284 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4003e17-5e12-423b-b1d6-551c9dfbd420 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:14.025967 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 604/1204] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:55:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:55:14.031592 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc8c92-ecd7-4fe0-9d76-4942188d6641 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:14.100017 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:14.168464 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc8c92-ecd7-4fe0-9d76-4942188d6641 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:14.210520 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57c7e0-152f-4db9-b4e3-af6bc8186ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:14.211202 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57c7e0-152f-4db9-b4e3-af6bc8186ef1 None admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:14.211426 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57c7e0-152f-4db9-b4e3-af6bc8186ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:14.211720 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57c7e0-152f-4db9-b4e3-af6bc8186ef1 None admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:14.212424 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d57c7e0-152f-4db9-b4e3-af6bc8186ef1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:14.213876 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d57c7e0-152f-4db9-b4e3-af6bc8186ef1 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:14.239798 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 601/1205] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Jul 27 18:55:14 2022] POST /identity/v3/users => generated 251 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:55:16.706572 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cce2e2-acca-464d-a25c-bda2c3237cc6 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:16.707118 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cce2e2-acca-464d-a25c-bda2c3237cc6 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:16.707247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cce2e2-acca-464d-a25c-bda2c3237cc6 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:16.708731 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 605/1206] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:55:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:55:16.714853 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb96a89-3d7f-4275-9ade-ec323bf2dde2 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:16.715289 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb96a89-3d7f-4275-9ade-ec323bf2dde2 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:16.715467 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb96a89-3d7f-4275-9ade-ec323bf2dde2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:16.736947 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-7eb96a89-3d7f-4275-9ade-ec323bf2dde2 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:55:16.738389 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-7eb96a89-3d7f-4275-9ade-ec323bf2dde2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:16.815294 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 602/1207] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:55:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:55:16.840560 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cce2e2-acca-464d-a25c-bda2c3237cc6 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:16.959989 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cce2e2-acca-464d-a25c-bda2c3237cc6 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:17.003268 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e30598-f266-42dc-a522-9515000d2f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:17.003988 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e30598-f266-42dc-a522-9515000d2f00 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:17.004298 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e30598-f266-42dc-a522-9515000d2f00 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:17.004561 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e30598-f266-42dc-a522-9515000d2f00 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:17.019930 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e30598-f266-42dc-a522-9515000d2f00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:55:17.025281 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-70e30598-f266-42dc-a522-9515000d2f00 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:55:17.025281 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:55:17.025281 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:55:17.025281 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:55:17.025281 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:55:17.025281 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:55:17.025281 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:55:17.025281 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:55:17.025281 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:55:17.025281 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:55:17.025281 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:55:17.025281 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:55:17.025281 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:55:17.025281 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:55:17.025281 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:55:17.025281 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:55:17.026682 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:55:17.026682 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:55:17.026682 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:55:17.026682 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:55:17.026682 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:55:17.026682 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:55:17.026682 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:55:17.026682 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:55:17.026682 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:55:17.026682 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:55:17.026682 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:55:17.026682 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:55:17.026682 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:55:17.026682 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:55:17.026682 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:55:17.026682 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:55:17.027733 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:55:17.027733 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:55:17.027733 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:55:17.027733 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:55:17.027733 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:55:17.027733 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:55:17.027733 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:55:17.027733 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:55:17.027733 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:55:17.027733 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:55:17.027733 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:55:17.027733 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:55:17.027733 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 606/1208] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 27 18:55:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:55:17.033233 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb96a89-3d7f-4275-9ade-ec323bf2dde2 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:17.080007 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:17.146777 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb96a89-3d7f-4275-9ade-ec323bf2dde2 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:17.192484 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de64c55-ea8a-4b85-bda8-f2cf43f24ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:17.194252 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de64c55-ea8a-4b85-bda8-f2cf43f24ac0 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:17.194252 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de64c55-ea8a-4b85-bda8-f2cf43f24ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:17.194252 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de64c55-ea8a-4b85-bda8-f2cf43f24ac0 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:17.194560 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de64c55-ea8a-4b85-bda8-f2cf43f24ac0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:55:17.194800 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de64c55-ea8a-4b85-bda8-f2cf43f24ac0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:17.196185 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de64c55-ea8a-4b85-bda8-f2cf43f24ac0 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:17.205796 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 603/1209] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Jul 27 18:55:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:55:17.211790 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e30598-f266-42dc-a522-9515000d2f00 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:17.283853 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:17.345112 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e30598-f266-42dc-a522-9515000d2f00 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:17.385547 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fdb251-30f6-4451-8c07-30b8e193ee89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:17.386216 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fdb251-30f6-4451-8c07-30b8e193ee89 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:17.386507 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fdb251-30f6-4451-8c07-30b8e193ee89 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:17.386771 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fdb251-30f6-4451-8c07-30b8e193ee89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:17.399572 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fdb251-30f6-4451-8c07-30b8e193ee89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:17.401079 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fdb251-30f6-4451-8c07-30b8e193ee89 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:17.416585 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-e8fdb251-30f6-4451-8c07-30b8e193ee89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:55:17.416585 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:55:17.416585 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:55:17.416585 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:55:17.416585 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:55:17.416585 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:55:17.416585 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:55:17.416585 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:55:17.416585 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:55:17.416585 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:55:17.416585 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:55:17.416585 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:55:17.416585 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:55:17.416585 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:55:17.416585 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:55:17.417789 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:55:17.417789 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:55:17.417789 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:55:17.417789 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:55:17.417789 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:55:17.417789 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:55:17.417789 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:55:17.417789 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:55:17.417789 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:55:17.417789 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:55:17.417789 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:55:17.417789 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:55:17.417789 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:55:17.417789 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:55:17.417789 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:55:17.417789 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:55:17.417789 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:55:17.424378 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:55:17.424378 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:55:17.424378 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:55:17.424378 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:55:17.424378 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 607/1210] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:55:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:55:17.424795 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de64c55-ea8a-4b85-bda8-f2cf43f24ac0 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:17.541507 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:17.544619 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de64c55-ea8a-4b85-bda8-f2cf43f24ac0 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:17.584058 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a020191-8b40-4655-9eee-f9190443cc6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:17.584770 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a020191-8b40-4655-9eee-f9190443cc6b None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:17.585147 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a020191-8b40-4655-9eee-f9190443cc6b None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:17.585425 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a020191-8b40-4655-9eee-f9190443cc6b None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:17.586121 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a020191-8b40-4655-9eee-f9190443cc6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:55:17.586424 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a020191-8b40-4655-9eee-f9190443cc6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:17.587881 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a020191-8b40-4655-9eee-f9190443cc6b None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:17.605457 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 604/1211] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:55:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:55:17.606625 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fdb251-30f6-4451-8c07-30b8e193ee89 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:17.720279 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fdb251-30f6-4451-8c07-30b8e193ee89 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:17.721856 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:17.756701 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee8136-ef93-4486-802a-08455942839f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:17.757385 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee8136-ef93-4486-802a-08455942839f None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:17.757665 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee8136-ef93-4486-802a-08455942839f None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:17.757985 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee8136-ef93-4486-802a-08455942839f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:17.766313 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee8136-ef93-4486-802a-08455942839f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:17.767782 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee8136-ef93-4486-802a-08455942839f None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:17.783048 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-56ee8136-ef93-4486-802a-08455942839f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 18:55:17.783048 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:55:17.783048 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:55:17.783048 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:55:17.783048 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:55:17.783048 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:55:17.783048 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:55:17.783048 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:55:17.783048 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:55:17.783048 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:55:17.783048 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:55:17.783048 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:55:17.783048 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:55:17.783048 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:55:17.783048 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:55:17.783048 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:55:17.785537 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:55:17.785537 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:55:17.785537 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:55:17.785537 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:55:17.785537 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:55:17.785537 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:55:17.785537 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:55:17.785537 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:55:17.785537 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:55:17.785537 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:55:17.785537 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:55:17.785537 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:55:17.785537 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:55:17.785537 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:55:17.785537 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:55:17.785537 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:55:17.785537 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:55:17.785537 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:55:17.786738 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:55:17.786738 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:55:17.786738 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:55:17.786738 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:55:17.786738 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:55:17.786738 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:55:17.786738 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:55:17.786738 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:55:17.786738 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 18:55:17.786738 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:55:17.786738 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 608/1212] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:55:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:55:17.790282 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a020191-8b40-4655-9eee-f9190443cc6b None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:17.901029 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a020191-8b40-4655-9eee-f9190443cc6b None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:17.938113 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112137a9-2bff-4919-ba60-69b2a8058d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:17.938726 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112137a9-2bff-4919-ba60-69b2a8058d9d None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:17.939018 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112137a9-2bff-4919-ba60-69b2a8058d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:17.939273 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112137a9-2bff-4919-ba60-69b2a8058d9d None admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:17.940098 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112137a9-2bff-4919-ba60-69b2a8058d9d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:55:17.940404 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112137a9-2bff-4919-ba60-69b2a8058d9d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:17.941813 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112137a9-2bff-4919-ba60-69b2a8058d9d None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:17.961119 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 605/1213] 10.222.0.20 () {56 vars in 1143 bytes} [Wed Jul 27 18:55:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:55:17.969652 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee8136-ef93-4486-802a-08455942839f None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:18.085178 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee8136-ef93-4486-802a-08455942839f None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:18.124247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb63537-fd87-4910-a3a9-96db82367f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:18.124879 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb63537-fd87-4910-a3a9-96db82367f5d None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:18.125541 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb63537-fd87-4910-a3a9-96db82367f5d None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:18.125541 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb63537-fd87-4910-a3a9-96db82367f5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:18.159518 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:18.206196 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb63537-fd87-4910-a3a9-96db82367f5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:18.207731 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb63537-fd87-4910-a3a9-96db82367f5d None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:18.320358 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 609/1214] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 27 18:55:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 18:55:18.326178 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112137a9-2bff-4919-ba60-69b2a8058d9d None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:18.346196 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:18.437947 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112137a9-2bff-4919-ba60-69b2a8058d9d None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:18.477078 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289a241-9d34-4717-a079-0dea6d147f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:18.477768 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289a241-9d34-4717-a079-0dea6d147f4c None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:18.478025 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289a241-9d34-4717-a079-0dea6d147f4c None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:18.478305 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289a241-9d34-4717-a079-0dea6d147f4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:18.491674 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2289a241-9d34-4717-a079-0dea6d147f4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:18.493165 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2289a241-9d34-4717-a079-0dea6d147f4c None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:18.510520 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-2289a241-9d34-4717-a079-0dea6d147f4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:55:18.510520 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:55:18.510520 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:55:18.510520 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:55:18.510520 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:55:18.510520 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:55:18.510520 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:55:18.510520 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:55:18.510520 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:55:18.510520 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:55:18.510520 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:55:18.510520 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:55:18.510520 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:55:18.510520 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:55:18.510520 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:55:18.511675 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:55:18.511675 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:55:18.511675 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:55:18.511675 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:55:18.511675 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:55:18.511675 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:55:18.511675 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:55:18.511675 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:55:18.511675 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:55:18.511675 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:55:18.511675 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:55:18.511675 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:55:18.511675 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:55:18.511675 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:55:18.511675 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:55:18.511675 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:55:18.511675 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:55:18.512946 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:55:18.512946 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:55:18.512946 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:55:18.512946 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:55:18.515863 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 606/1215] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:55:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:55:18.517551 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb63537-fd87-4910-a3a9-96db82367f5d None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:18.587963 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:18.642502 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb63537-fd87-4910-a3a9-96db82367f5d None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:18.687564 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ed177-b046-4320-a9b7-fe001e9a637f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:18.688320 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ed177-b046-4320-a9b7-fe001e9a637f None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:18.688535 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ed177-b046-4320-a9b7-fe001e9a637f None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:18.688808 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ed177-b046-4320-a9b7-fe001e9a637f None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:18.689847 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2ed177-b046-4320-a9b7-fe001e9a637f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:55:18.690191 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2ed177-b046-4320-a9b7-fe001e9a637f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:18.691819 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2ed177-b046-4320-a9b7-fe001e9a637f None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:18.705026 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 610/1216] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:55:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:55:18.710758 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289a241-9d34-4717-a079-0dea6d147f4c None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:18.789314 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:18.831165 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289a241-9d34-4717-a079-0dea6d147f4c None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:18.869824 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282deee2-af05-48e6-b1d2-1ea13355f9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:18.870588 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282deee2-af05-48e6-b1d2-1ea13355f9ac None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:18.871006 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282deee2-af05-48e6-b1d2-1ea13355f9ac None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:18.871355 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282deee2-af05-48e6-b1d2-1ea13355f9ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:18.879491 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282deee2-af05-48e6-b1d2-1ea13355f9ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:18.881258 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282deee2-af05-48e6-b1d2-1ea13355f9ac None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:18.895987 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-282deee2-af05-48e6-b1d2-1ea13355f9ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:55:18.895987 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:55:18.895987 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:55:18.895987 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:55:18.895987 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:55:18.895987 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:55:18.895987 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:55:18.895987 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:55:18.895987 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:55:18.895987 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:55:18.895987 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:55:18.895987 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:55:18.895987 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:55:18.895987 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:55:18.895987 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:55:18.897116 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:55:18.897116 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:55:18.897116 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:55:18.897116 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:55:18.897116 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:55:18.897116 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:55:18.897116 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:55:18.897116 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:55:18.897116 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:55:18.897116 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:55:18.897116 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:55:18.897116 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:55:18.897116 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:55:18.897116 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:55:18.897116 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:55:18.897116 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:55:18.897116 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:55:18.898378 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:55:18.898378 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:55:18.898378 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:55:18.898378 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:55:18.898378 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:55:18.898378 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:55:18.898378 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:55:18.898378 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:55:18.898378 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 607/1217] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 27 18:55:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:55:18.903419 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ed177-b046-4320-a9b7-fe001e9a637f None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:19.011731 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ed177-b046-4320-a9b7-fe001e9a637f None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:19.035302 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:19.051321 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2655ea-7207-43ea-be7c-84d21397c9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:19.051996 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2655ea-7207-43ea-be7c-84d21397c9ea None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:19.052274 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2655ea-7207-43ea-be7c-84d21397c9ea None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:19.052556 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2655ea-7207-43ea-be7c-84d21397c9ea None admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:19.053330 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2655ea-7207-43ea-be7c-84d21397c9ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:55:19.053637 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2655ea-7207-43ea-be7c-84d21397c9ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:19.055060 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2655ea-7207-43ea-be7c-84d21397c9ea None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:19.068649 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 611/1218] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 27 18:55:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:55:19.074916 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282deee2-af05-48e6-b1d2-1ea13355f9ac None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:19.183725 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282deee2-af05-48e6-b1d2-1ea13355f9ac None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:19.216266 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:19.223311 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d8300-dcac-49bc-83a8-c0ac72885a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:19.224027 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d8300-dcac-49bc-83a8-c0ac72885a0a None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:19.224377 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d8300-dcac-49bc-83a8-c0ac72885a0a None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:19.224717 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d8300-dcac-49bc-83a8-c0ac72885a0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:19.225802 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d8300-dcac-49bc-83a8-c0ac72885a0a None admin] RBAC: Adding query filter params (role.id=306da3282d854292a7a53b8642ee373b, scope.project.id=31f027c53398443eb548eaf3f24523e0, user.id=3b0382b170fb49e785a57bbb329d4b37) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:55:19.226204 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d8300-dcac-49bc-83a8-c0ac72885a0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:19.227741 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d8300-dcac-49bc-83a8-c0ac72885a0a None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:19.234906 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 608/1219] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 27 18:55:19 2022] GET /identity/v3/role_assignments?user.id=3b0382b170fb49e785a57bbb329d4b37&scope.project.id=31f027c53398443eb548eaf3f24523e0&role.id=306da3282d854292a7a53b8642ee373b => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:55:21.240774 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33b680-320d-4c59-aeb1-bfee99419231 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:21.241388 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33b680-320d-4c59-aeb1-bfee99419231 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:21.241388 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33b680-320d-4c59-aeb1-bfee99419231 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:21.242900 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 612/1220] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:55:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:55:21.248214 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e72f09-10a7-46b5-a448-3599cc145398 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:21.248924 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e72f09-10a7-46b5-a448-3599cc145398 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:21.249148 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e72f09-10a7-46b5-a448-3599cc145398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:21.275314 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-57e72f09-10a7-46b5-a448-3599cc145398 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:55:21.275614 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-57e72f09-10a7-46b5-a448-3599cc145398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:21.353218 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 609/1221] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:55:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:55:21.375298 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c33b680-320d-4c59-aeb1-bfee99419231 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:21.485676 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c33b680-320d-4c59-aeb1-bfee99419231 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:21.524021 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225f77a0-9cb1-48aa-a811-7060a07bcad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:21.524682 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f77a0-9cb1-48aa-a811-7060a07bcad8 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:21.525025 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f77a0-9cb1-48aa-a811-7060a07bcad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:21.525357 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f77a0-9cb1-48aa-a811-7060a07bcad8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:21.535999 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225f77a0-9cb1-48aa-a811-7060a07bcad8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:55:21.540817 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-225f77a0-9cb1-48aa-a811-7060a07bcad8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:55:21.540817 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:55:21.540817 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:55:21.540817 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:55:21.540817 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:55:21.540817 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:55:21.540817 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:55:21.540817 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:55:21.540817 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:55:21.540817 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:55:21.540817 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:55:21.540817 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:55:21.540817 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:55:21.540817 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:55:21.540817 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:55:21.540817 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:55:21.541974 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:55:21.541974 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:55:21.541974 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:55:21.541974 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:55:21.541974 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:55:21.541974 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:55:21.541974 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:55:21.541974 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:55:21.541974 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:55:21.541974 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:55:21.541974 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:55:21.541974 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:55:21.541974 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:55:21.541974 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:55:21.541974 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:55:21.541974 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:55:21.542869 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:55:21.542869 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:55:21.542869 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:55:21.542869 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:55:21.542869 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:55:21.542869 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:55:21.542869 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:55:21.542869 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:55:21.542869 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:55:21.542869 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:55:21.542869 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:55:21.542869 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:55:21.542869 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 613/1222] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 27 18:55:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:55:21.548489 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e72f09-10a7-46b5-a448-3599cc145398 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:21.662528 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e72f09-10a7-46b5-a448-3599cc145398 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:21.686918 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:21.700957 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef1ea6-99ca-45ff-bd9c-fb365c44e1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:21.701591 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef1ea6-99ca-45ff-bd9c-fb365c44e1d0 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:21.701871 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef1ea6-99ca-45ff-bd9c-fb365c44e1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:21.702142 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef1ea6-99ca-45ff-bd9c-fb365c44e1d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:21.702885 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef1ea6-99ca-45ff-bd9c-fb365c44e1d0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:55:21.703188 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef1ea6-99ca-45ff-bd9c-fb365c44e1d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:21.704598 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef1ea6-99ca-45ff-bd9c-fb365c44e1d0 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:21.712432 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 610/1223] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Jul 27 18:55:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:55:21.718750 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225f77a0-9cb1-48aa-a811-7060a07bcad8 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:21.767877 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:21.826404 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225f77a0-9cb1-48aa-a811-7060a07bcad8 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:21.860985 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f5e17-7a30-47e6-ba1c-0993f224013a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:21.861618 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f5e17-7a30-47e6-ba1c-0993f224013a None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:21.861902 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f5e17-7a30-47e6-ba1c-0993f224013a None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:21.862227 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f5e17-7a30-47e6-ba1c-0993f224013a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:21.873034 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191f5e17-7a30-47e6-ba1c-0993f224013a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:21.874620 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191f5e17-7a30-47e6-ba1c-0993f224013a None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:21.888737 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-191f5e17-7a30-47e6-ba1c-0993f224013a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:55:21.888737 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:55:21.888737 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:55:21.888737 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:55:21.888737 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:55:21.888737 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:55:21.888737 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:55:21.888737 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:55:21.888737 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:55:21.888737 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:55:21.888737 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:55:21.888737 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:55:21.888737 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:55:21.888737 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:55:21.888737 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:55:21.889829 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:55:21.889829 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:55:21.889829 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:55:21.889829 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:55:21.889829 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:55:21.889829 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:55:21.889829 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:55:21.889829 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:55:21.889829 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:55:21.889829 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:55:21.889829 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:55:21.889829 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:55:21.889829 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:55:21.889829 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:55:21.889829 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:55:21.889829 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:55:21.889829 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:55:21.891134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:55:21.891134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:55:21.891134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:55:21.891134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:55:21.891134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 614/1224] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:55:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:55:21.895840 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef1ea6-99ca-45ff-bd9c-fb365c44e1d0 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:22.001679 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef1ea6-99ca-45ff-bd9c-fb365c44e1d0 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:22.039214 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f53dd4-60c0-4bb8-ae67-f0b80554b149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:22.039993 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f53dd4-60c0-4bb8-ae67-f0b80554b149 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:22.040372 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f53dd4-60c0-4bb8-ae67-f0b80554b149 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:22.040845 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f53dd4-60c0-4bb8-ae67-f0b80554b149 None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:22.041635 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f53dd4-60c0-4bb8-ae67-f0b80554b149 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:55:22.041937 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f53dd4-60c0-4bb8-ae67-f0b80554b149 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:22.043483 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f53dd4-60c0-4bb8-ae67-f0b80554b149 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:22.057539 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 611/1225] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:55:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:55:22.063369 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f5e17-7a30-47e6-ba1c-0993f224013a None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:22.162628 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:22.171397 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f5e17-7a30-47e6-ba1c-0993f224013a None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:22.205305 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39deb9-10fc-4cdd-848c-817fca8ea73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:22.205935 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39deb9-10fc-4cdd-848c-817fca8ea73b None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:22.206211 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39deb9-10fc-4cdd-848c-817fca8ea73b None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:22.206480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39deb9-10fc-4cdd-848c-817fca8ea73b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:22.213930 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39deb9-10fc-4cdd-848c-817fca8ea73b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:22.215343 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39deb9-10fc-4cdd-848c-817fca8ea73b None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:22.228821 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-2f39deb9-10fc-4cdd-848c-817fca8ea73b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 18:55:22.228821 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:55:22.228821 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:55:22.228821 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:55:22.228821 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:55:22.228821 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:55:22.228821 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:55:22.228821 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:55:22.228821 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:55:22.228821 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:55:22.228821 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:55:22.228821 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:55:22.228821 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:55:22.228821 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:55:22.228821 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:55:22.228821 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:55:22.230337 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:55:22.230337 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:55:22.230337 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:55:22.230337 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:55:22.230337 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:55:22.230337 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:55:22.230337 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:55:22.230337 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:55:22.230337 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:55:22.230337 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:55:22.230337 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:55:22.230337 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:55:22.230337 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:55:22.230337 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:55:22.230337 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:55:22.230337 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:55:22.230337 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:55:22.230337 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:55:22.231622 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:55:22.231622 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:55:22.231622 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:55:22.231622 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:55:22.231622 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:55:22.231622 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:55:22.231622 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:55:22.231622 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:55:22.231622 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 18:55:22.231622 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:55:22.231622 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 615/1226] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:55:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:55:22.236632 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f53dd4-60c0-4bb8-ae67-f0b80554b149 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:22.291416 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:22.353092 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f53dd4-60c0-4bb8-ae67-f0b80554b149 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:22.386633 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e8fbac-3692-4763-95a7-e7b967853447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:22.387243 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8fbac-3692-4763-95a7-e7b967853447 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:22.387523 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8fbac-3692-4763-95a7-e7b967853447 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:22.387822 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8fbac-3692-4763-95a7-e7b967853447 None admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:22.389214 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e8fbac-3692-4763-95a7-e7b967853447 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:55:22.389530 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e8fbac-3692-4763-95a7-e7b967853447 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:22.390939 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e8fbac-3692-4763-95a7-e7b967853447 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:22.409815 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 612/1227] 10.222.0.20 () {56 vars in 1143 bytes} [Wed Jul 27 18:55:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:55:22.415594 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39deb9-10fc-4cdd-848c-817fca8ea73b None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:22.526330 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39deb9-10fc-4cdd-848c-817fca8ea73b None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:22.563172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a993bd5c-ac1c-4703-977d-1acbe0954084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:22.563903 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993bd5c-ac1c-4703-977d-1acbe0954084 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:22.564184 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993bd5c-ac1c-4703-977d-1acbe0954084 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:22.564531 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993bd5c-ac1c-4703-977d-1acbe0954084 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:22.575799 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a993bd5c-ac1c-4703-977d-1acbe0954084 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:22.577954 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a993bd5c-ac1c-4703-977d-1acbe0954084 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:22.592967 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-a993bd5c-ac1c-4703-977d-1acbe0954084 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:55:22.592967 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:55:22.592967 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:55:22.592967 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:55:22.592967 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:55:22.592967 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:55:22.592967 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:55:22.592967 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:55:22.592967 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:55:22.592967 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:55:22.592967 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:55:22.592967 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:55:22.592967 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:55:22.592967 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:55:22.592967 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:55:22.593910 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:55:22.593910 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:55:22.593910 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:55:22.593910 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:55:22.593910 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:55:22.593910 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:55:22.593910 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:55:22.593910 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:55:22.593910 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:55:22.593910 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:55:22.593910 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:55:22.593910 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:55:22.593910 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:55:22.593910 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:55:22.593910 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:55:22.593910 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:55:22.593910 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:55:22.594813 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:55:22.594813 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:55:22.594813 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:55:22.594813 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:55:22.594813 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 616/1228] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:55:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:55:22.600213 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e8fbac-3692-4763-95a7-e7b967853447 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:22.710612 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e8fbac-3692-4763-95a7-e7b967853447 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:22.712873 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:22.750732 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c0f32-2273-465a-8625-1961075888a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:22.751441 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c0f32-2273-465a-8625-1961075888a7 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:22.751794 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c0f32-2273-465a-8625-1961075888a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:22.752120 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c0f32-2273-465a-8625-1961075888a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:22.752871 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244c0f32-2273-465a-8625-1961075888a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:55:22.753200 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244c0f32-2273-465a-8625-1961075888a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:22.754919 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244c0f32-2273-465a-8625-1961075888a7 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:22.768687 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 613/1229] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:55:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:55:22.774619 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a993bd5c-ac1c-4703-977d-1acbe0954084 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:22.785660 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:22.886442 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a993bd5c-ac1c-4703-977d-1acbe0954084 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:22.923875 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5c8b9-a00c-4248-b080-0740f48023b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:22.924593 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5c8b9-a00c-4248-b080-0740f48023b3 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:22.925011 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5c8b9-a00c-4248-b080-0740f48023b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:22.925353 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5c8b9-a00c-4248-b080-0740f48023b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:22.932806 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed5c8b9-a00c-4248-b080-0740f48023b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:22.934453 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed5c8b9-a00c-4248-b080-0740f48023b3 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:22.945928 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-bed5c8b9-a00c-4248-b080-0740f48023b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:55:22.945928 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:55:22.945928 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:55:22.945928 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:55:22.945928 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:55:22.945928 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:55:22.945928 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:55:22.945928 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:55:22.945928 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:55:22.945928 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:55:22.945928 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:55:22.945928 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:55:22.945928 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:55:22.945928 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:55:22.945928 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:55:22.946897 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:55:22.946897 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:55:22.946897 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:55:22.946897 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:55:22.946897 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:55:22.946897 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:55:22.946897 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:55:22.946897 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:55:22.946897 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:55:22.946897 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:55:22.946897 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:55:22.946897 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:55:22.946897 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:55:22.946897 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:55:22.946897 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:55:22.946897 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:55:22.946897 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:55:22.947853 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:55:22.947853 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:55:22.947853 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:55:22.947853 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:55:22.947853 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:55:22.947853 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:55:22.947853 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:55:22.947853 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:55:22.947853 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 617/1230] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 27 18:55:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:55:22.953954 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c0f32-2273-465a-8625-1961075888a7 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:23.063862 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c0f32-2273-465a-8625-1961075888a7 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:23.108824 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd791e6c-2e1f-44da-8215-54d6e9fc95c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:23.109563 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd791e6c-2e1f-44da-8215-54d6e9fc95c8 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:23.109894 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd791e6c-2e1f-44da-8215-54d6e9fc95c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:23.110262 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd791e6c-2e1f-44da-8215-54d6e9fc95c8 None admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:23.111010 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd791e6c-2e1f-44da-8215-54d6e9fc95c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:55:23.111322 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd791e6c-2e1f-44da-8215-54d6e9fc95c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:23.112964 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd791e6c-2e1f-44da-8215-54d6e9fc95c8 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:23.126975 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 614/1231] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 27 18:55:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:55:23.133609 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5c8b9-a00c-4248-b080-0740f48023b3 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:23.209458 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:23.248002 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5c8b9-a00c-4248-b080-0740f48023b3 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:23.288755 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91806bd9-f7b5-4aa5-9faf-5f77e556175f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:23.289515 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91806bd9-f7b5-4aa5-9faf-5f77e556175f None admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:23.289824 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91806bd9-f7b5-4aa5-9faf-5f77e556175f None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:23.290156 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91806bd9-f7b5-4aa5-9faf-5f77e556175f None admin] PATH_INFO: `/v3/projects/31f027c53398443eb548eaf3f24523e0/users/3b0382b170fb49e785a57bbb329d4b37/roles/306da3282d854292a7a53b8642ee373b` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:23.307278 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91806bd9-f7b5-4aa5-9faf-5f77e556175f None admin] RBAC: Authorizing `identity:create_grant(project_id=31f027c53398443eb548eaf3f24523e0, user_id=3b0382b170fb49e785a57bbb329d4b37, role_id=306da3282d854292a7a53b8642ee373b)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:23.308903 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91806bd9-f7b5-4aa5-9faf-5f77e556175f None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:23.322750 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 618/1232] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 27 18:55:23 2022] PUT /identity/v3/projects/31f027c53398443eb548eaf3f24523e0/users/3b0382b170fb49e785a57bbb329d4b37/roles/306da3282d854292a7a53b8642ee373b => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:55:25.436304 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709c9cc-aba1-46a9-93c0-32e78a148dc6 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:25.436841 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709c9cc-aba1-46a9-93c0-32e78a148dc6 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:25.436841 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709c9cc-aba1-46a9-93c0-32e78a148dc6 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:25.438197 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 615/1233] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:55:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:55:25.443351 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda50aa-c03c-4f66-a0f6-7d3424bcda06 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:25.443797 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda50aa-c03c-4f66-a0f6-7d3424bcda06 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:25.443934 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda50aa-c03c-4f66-a0f6-7d3424bcda06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:25.463170 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-8dda50aa-c03c-4f66-a0f6-7d3424bcda06 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:55:25.464462 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-8dda50aa-c03c-4f66-a0f6-7d3424bcda06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:25.539116 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 619/1234] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:55:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:55:25.562598 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709c9cc-aba1-46a9-93c0-32e78a148dc6 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:25.587554 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:25.672906 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709c9cc-aba1-46a9-93c0-32e78a148dc6 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:25.713663 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9698267a-f341-43e0-ba25-bacdaafba41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:25.714223 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9698267a-f341-43e0-ba25-bacdaafba41b None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:25.714505 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9698267a-f341-43e0-ba25-bacdaafba41b None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:25.714778 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9698267a-f341-43e0-ba25-bacdaafba41b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:25.725558 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9698267a-f341-43e0-ba25-bacdaafba41b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:55:25.730693 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-9698267a-f341-43e0-ba25-bacdaafba41b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:55:25.730693 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:55:25.730693 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:55:25.730693 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:55:25.730693 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:55:25.730693 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:55:25.730693 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:55:25.730693 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:55:25.730693 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:55:25.730693 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:55:25.730693 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:55:25.730693 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:55:25.730693 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:55:25.730693 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:55:25.730693 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:55:25.730693 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:55:25.732016 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:55:25.732016 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:55:25.732016 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:55:25.732016 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:55:25.732016 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:55:25.732016 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:55:25.732016 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:55:25.732016 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:55:25.732016 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:55:25.732016 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:55:25.732016 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:55:25.732016 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:55:25.732016 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:55:25.732016 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:55:25.732016 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:55:25.732016 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:55:25.732909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:55:25.732909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:55:25.732909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:55:25.732909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:55:25.732909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:55:25.732909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:55:25.732909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:55:25.732909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:55:25.732909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:55:25.732909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:55:25.732909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:55:25.732909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:55:25.732909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 616/1235] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 27 18:55:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:55:25.738838 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda50aa-c03c-4f66-a0f6-7d3424bcda06 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:25.790055 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:25.849276 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda50aa-c03c-4f66-a0f6-7d3424bcda06 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:25.886091 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f618340d-5c0b-4e36-8786-ba2d6da4cce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:25.886702 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618340d-5c0b-4e36-8786-ba2d6da4cce1 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:25.886985 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618340d-5c0b-4e36-8786-ba2d6da4cce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:25.887259 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618340d-5c0b-4e36-8786-ba2d6da4cce1 None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:25.888003 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f618340d-5c0b-4e36-8786-ba2d6da4cce1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:55:25.888838 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f618340d-5c0b-4e36-8786-ba2d6da4cce1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:25.890194 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f618340d-5c0b-4e36-8786-ba2d6da4cce1 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:25.898954 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 620/1236] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Jul 27 18:55:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:55:25.905566 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9698267a-f341-43e0-ba25-bacdaafba41b None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:25.997371 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:26.015365 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9698267a-f341-43e0-ba25-bacdaafba41b None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:26.053173 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc591b-c066-4c0d-bd43-320e25058400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:26.053813 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc591b-c066-4c0d-bd43-320e25058400 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:26.054092 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc591b-c066-4c0d-bd43-320e25058400 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:26.054362 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc591b-c066-4c0d-bd43-320e25058400 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:26.067199 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dc591b-c066-4c0d-bd43-320e25058400 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:26.068683 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dc591b-c066-4c0d-bd43-320e25058400 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:26.083965 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-31dc591b-c066-4c0d-bd43-320e25058400 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:55:26.083965 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:55:26.083965 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:55:26.083965 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:55:26.083965 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:55:26.083965 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:55:26.083965 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:55:26.083965 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:55:26.083965 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:55:26.083965 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:55:26.083965 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:55:26.083965 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:55:26.083965 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:55:26.083965 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:55:26.083965 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:55:26.084952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:55:26.084952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:55:26.084952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:55:26.084952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:55:26.084952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:55:26.084952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:55:26.084952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:55:26.084952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:55:26.084952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:55:26.084952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:55:26.084952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:55:26.084952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:55:26.084952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:55:26.084952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:55:26.084952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:55:26.084952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:55:26.084952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:55:26.085849 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:55:26.085849 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:55:26.085849 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:55:26.085849 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:55:26.086595 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 617/1237] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:55:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:55:26.093094 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f618340d-5c0b-4e36-8786-ba2d6da4cce1 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:26.210087 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f618340d-5c0b-4e36-8786-ba2d6da4cce1 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:26.220027 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:26.249537 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d4144-7ff1-46ad-b57a-fe4cc6d154f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:26.250198 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d4144-7ff1-46ad-b57a-fe4cc6d154f4 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:26.250563 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d4144-7ff1-46ad-b57a-fe4cc6d154f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:26.250870 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d4144-7ff1-46ad-b57a-fe4cc6d154f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:26.251786 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665d4144-7ff1-46ad-b57a-fe4cc6d154f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:55:26.252157 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665d4144-7ff1-46ad-b57a-fe4cc6d154f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:26.253783 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665d4144-7ff1-46ad-b57a-fe4cc6d154f4 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:26.267901 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 621/1238] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:55:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:55:26.274289 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc591b-c066-4c0d-bd43-320e25058400 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:26.385925 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc591b-c066-4c0d-bd43-320e25058400 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:26.426916 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df5bff3-9932-48f2-b30b-ca8890ff7c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:26.427556 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5bff3-9932-48f2-b30b-ca8890ff7c2d None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:26.427871 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5bff3-9932-48f2-b30b-ca8890ff7c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:26.428148 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5bff3-9932-48f2-b30b-ca8890ff7c2d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:26.431212 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:26.439494 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df5bff3-9932-48f2-b30b-ca8890ff7c2d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:26.441671 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df5bff3-9932-48f2-b30b-ca8890ff7c2d None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:26.455372 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-0df5bff3-9932-48f2-b30b-ca8890ff7c2d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 18:55:26.455372 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:55:26.455372 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:55:26.455372 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:55:26.455372 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:55:26.455372 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:55:26.455372 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:55:26.455372 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:55:26.455372 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:55:26.455372 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:55:26.455372 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:55:26.455372 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:55:26.455372 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:55:26.455372 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:55:26.455372 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:55:26.455372 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:55:26.456552 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:55:26.456552 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:55:26.456552 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:55:26.456552 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:55:26.456552 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:55:26.456552 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:55:26.456552 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:55:26.456552 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:55:26.456552 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:55:26.456552 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:55:26.456552 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:55:26.456552 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:55:26.456552 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:55:26.456552 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:55:26.456552 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:55:26.456552 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:55:26.456552 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:55:26.456552 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:55:26.457768 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:55:26.457768 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:55:26.457768 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:55:26.457768 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:55:26.457768 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:55:26.457768 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:55:26.457768 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:55:26.457768 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:55:26.457768 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 18:55:26.457768 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:55:26.457768 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 618/1239] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:55:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:55:26.462373 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d4144-7ff1-46ad-b57a-fe4cc6d154f4 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:26.587317 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d4144-7ff1-46ad-b57a-fe4cc6d154f4 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:26.627487 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b3bb29-0ddf-4110-b8aa-7c8fc8f23498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:26.628134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b3bb29-0ddf-4110-b8aa-7c8fc8f23498 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:26.628410 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b3bb29-0ddf-4110-b8aa-7c8fc8f23498 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:26.628682 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b3bb29-0ddf-4110-b8aa-7c8fc8f23498 None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:26.629537 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b3bb29-0ddf-4110-b8aa-7c8fc8f23498 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:55:26.629864 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b3bb29-0ddf-4110-b8aa-7c8fc8f23498 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:26.631314 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b3bb29-0ddf-4110-b8aa-7c8fc8f23498 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:26.649930 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 622/1240] 10.222.0.20 () {56 vars in 1143 bytes} [Wed Jul 27 18:55:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:55:26.655939 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df5bff3-9932-48f2-b30b-ca8890ff7c2d None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:26.764070 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df5bff3-9932-48f2-b30b-ca8890ff7c2d None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:26.801313 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dfc5c3-0903-4e73-9517-963b8a0e6fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:26.801867 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfc5c3-0903-4e73-9517-963b8a0e6fe7 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:26.802147 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfc5c3-0903-4e73-9517-963b8a0e6fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:26.802421 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfc5c3-0903-4e73-9517-963b8a0e6fe7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:26.866061 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:26.873254 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dfc5c3-0903-4e73-9517-963b8a0e6fe7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:26.874873 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dfc5c3-0903-4e73-9517-963b8a0e6fe7 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:26.982852 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 619/1241] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 27 18:55:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 18:55:26.991475 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b3bb29-0ddf-4110-b8aa-7c8fc8f23498 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:27.024847 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:27.115662 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b3bb29-0ddf-4110-b8aa-7c8fc8f23498 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:27.150962 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc273de4-e05e-4e0e-95ea-3e1d0acbebff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:27.151592 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc273de4-e05e-4e0e-95ea-3e1d0acbebff None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:27.151904 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc273de4-e05e-4e0e-95ea-3e1d0acbebff None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:27.152179 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc273de4-e05e-4e0e-95ea-3e1d0acbebff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:27.162498 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc273de4-e05e-4e0e-95ea-3e1d0acbebff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:27.163944 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc273de4-e05e-4e0e-95ea-3e1d0acbebff None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:27.178921 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-dc273de4-e05e-4e0e-95ea-3e1d0acbebff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:55:27.178921 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:55:27.178921 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:55:27.178921 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:55:27.178921 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:55:27.178921 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:55:27.178921 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:55:27.178921 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:55:27.178921 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:55:27.178921 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:55:27.178921 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:55:27.178921 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:55:27.178921 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:55:27.178921 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:55:27.178921 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:55:27.180125 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:55:27.180125 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:55:27.180125 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:55:27.180125 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:55:27.180125 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:55:27.180125 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:55:27.180125 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:55:27.180125 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:55:27.180125 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:55:27.180125 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:55:27.180125 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:55:27.180125 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:55:27.180125 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:55:27.180125 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:55:27.180125 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:55:27.180125 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:55:27.180125 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:55:27.181035 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:55:27.181035 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:55:27.181035 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:55:27.181035 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:55:27.181035 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 623/1242] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:55:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:55:27.185998 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dfc5c3-0903-4e73-9517-963b8a0e6fe7 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:27.289000 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:27.295572 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dfc5c3-0903-4e73-9517-963b8a0e6fe7 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:27.335436 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b957d-563d-4ab5-9d5c-7a1c4989b958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:27.336150 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b957d-563d-4ab5-9d5c-7a1c4989b958 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:27.336489 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b957d-563d-4ab5-9d5c-7a1c4989b958 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:27.336685 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b957d-563d-4ab5-9d5c-7a1c4989b958 None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:27.337418 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8b957d-563d-4ab5-9d5c-7a1c4989b958 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:55:27.337732 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8b957d-563d-4ab5-9d5c-7a1c4989b958 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:27.339052 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8b957d-563d-4ab5-9d5c-7a1c4989b958 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:27.351912 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 620/1243] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:55:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:55:27.357839 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc273de4-e05e-4e0e-95ea-3e1d0acbebff None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:27.446294 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:27.469747 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc273de4-e05e-4e0e-95ea-3e1d0acbebff None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:27.507731 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17155a39-cb7f-41e6-8f58-43c9cb9d6c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:27.508401 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17155a39-cb7f-41e6-8f58-43c9cb9d6c99 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:27.508740 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17155a39-cb7f-41e6-8f58-43c9cb9d6c99 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:27.508962 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17155a39-cb7f-41e6-8f58-43c9cb9d6c99 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:27.516564 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17155a39-cb7f-41e6-8f58-43c9cb9d6c99 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:27.517986 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17155a39-cb7f-41e6-8f58-43c9cb9d6c99 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:27.530311 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-17155a39-cb7f-41e6-8f58-43c9cb9d6c99 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:55:27.530311 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:55:27.530311 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:55:27.530311 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:55:27.530311 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:55:27.530311 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:55:27.530311 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:55:27.530311 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:55:27.530311 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:55:27.530311 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:55:27.530311 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:55:27.530311 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:55:27.530311 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:55:27.530311 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:55:27.530311 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:55:27.531471 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:55:27.531471 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:55:27.531471 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:55:27.531471 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:55:27.531471 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:55:27.531471 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:55:27.531471 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:55:27.531471 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:55:27.531471 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:55:27.531471 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:55:27.531471 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:55:27.531471 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:55:27.531471 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:55:27.531471 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:55:27.531471 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:55:27.531471 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:55:27.531471 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:55:27.532459 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:55:27.532459 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:55:27.532459 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:55:27.532459 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:55:27.532459 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:55:27.532459 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:55:27.532459 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:55:27.532459 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:55:27.532459 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 624/1244] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 27 18:55:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:55:27.538023 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b957d-563d-4ab5-9d5c-7a1c4989b958 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:27.645346 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b957d-563d-4ab5-9d5c-7a1c4989b958 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:27.686387 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2938d32f-0f15-46dd-a56b-2ee0a8c50cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:27.687003 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938d32f-0f15-46dd-a56b-2ee0a8c50cdd None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:27.687282 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938d32f-0f15-46dd-a56b-2ee0a8c50cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:27.687551 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938d32f-0f15-46dd-a56b-2ee0a8c50cdd None admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:27.688332 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2938d32f-0f15-46dd-a56b-2ee0a8c50cdd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:55:27.688640 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2938d32f-0f15-46dd-a56b-2ee0a8c50cdd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:27.690057 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2938d32f-0f15-46dd-a56b-2ee0a8c50cdd None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:27.702824 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 621/1245] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 27 18:55:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:55:27.709100 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17155a39-cb7f-41e6-8f58-43c9cb9d6c99 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:27.811647 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17155a39-cb7f-41e6-8f58-43c9cb9d6c99 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:27.851815 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8257dd73-66fd-4717-ade7-33bb0e0375a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:27.852421 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8257dd73-66fd-4717-ade7-33bb0e0375a0 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:27.852696 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8257dd73-66fd-4717-ade7-33bb0e0375a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:27.852963 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8257dd73-66fd-4717-ade7-33bb0e0375a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:27.853790 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8257dd73-66fd-4717-ade7-33bb0e0375a0 None admin] RBAC: Adding query filter params (role.id=306da3282d854292a7a53b8642ee373b, scope.project.id=31f027c53398443eb548eaf3f24523e0, user.id=3b0382b170fb49e785a57bbb329d4b37) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:55:27.854047 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8257dd73-66fd-4717-ade7-33bb0e0375a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:27.855479 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8257dd73-66fd-4717-ade7-33bb0e0375a0 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:27.861642 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 625/1246] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 27 18:55:27 2022] GET /identity/v3/role_assignments?user.id=3b0382b170fb49e785a57bbb329d4b37&scope.project.id=31f027c53398443eb548eaf3f24523e0&role.id=306da3282d854292a7a53b8642ee373b => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:55:30.009969 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4bd53-fbac-43f5-aa35-9d98f4191505 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:30.010663 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4bd53-fbac-43f5-aa35-9d98f4191505 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:30.010663 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4bd53-fbac-43f5-aa35-9d98f4191505 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:30.011902 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 622/1247] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:55:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:55:30.017646 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0641b6-76a5-412c-99c0-7acbe9209f4f None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:30.018134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0641b6-76a5-412c-99c0-7acbe9209f4f None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:30.018231 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0641b6-76a5-412c-99c0-7acbe9209f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:30.024597 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:30.037227 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-1a0641b6-76a5-412c-99c0-7acbe9209f4f None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:55:30.038587 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-1a0641b6-76a5-412c-99c0-7acbe9209f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:30.114530 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 626/1248] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:55:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:55:30.141883 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d4bd53-fbac-43f5-aa35-9d98f4191505 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:30.164351 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:30.265742 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d4bd53-fbac-43f5-aa35-9d98f4191505 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:30.308400 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b07fdb-91c2-4220-9f48-fee7183c6d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:30.309036 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b07fdb-91c2-4220-9f48-fee7183c6d4b None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:30.309333 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b07fdb-91c2-4220-9f48-fee7183c6d4b None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:30.309651 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b07fdb-91c2-4220-9f48-fee7183c6d4b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:30.322532 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b07fdb-91c2-4220-9f48-fee7183c6d4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:55:30.328468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-14b07fdb-91c2-4220-9f48-fee7183c6d4b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:55:30.328468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:55:30.328468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:55:30.328468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:55:30.328468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:55:30.328468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:55:30.328468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:55:30.328468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:55:30.328468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:55:30.328468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:55:30.328468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:55:30.328468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:55:30.328468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:55:30.328468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:55:30.328468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:55:30.328468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:55:30.329682 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:55:30.329682 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:55:30.329682 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:55:30.329682 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:55:30.329682 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:55:30.329682 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:55:30.329682 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:55:30.329682 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:55:30.329682 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:55:30.329682 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:55:30.329682 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:55:30.329682 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:55:30.329682 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:55:30.329682 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:55:30.329682 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:55:30.329682 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:55:30.330755 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:55:30.330755 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:55:30.330755 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:55:30.330755 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:55:30.330755 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:55:30.330755 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:55:30.330755 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:55:30.330755 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:55:30.330755 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:55:30.330755 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:55:30.330755 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:55:30.330755 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:55:30.330755 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 623/1249] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 27 18:55:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:55:30.337274 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0641b6-76a5-412c-99c0-7acbe9209f4f None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:30.459124 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0641b6-76a5-412c-99c0-7acbe9209f4f None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:30.495336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:30.501602 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092bf9a-5a7b-456d-a715-53feb6a826ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:30.502324 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092bf9a-5a7b-456d-a715-53feb6a826ba None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:30.502613 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092bf9a-5a7b-456d-a715-53feb6a826ba None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:30.502923 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092bf9a-5a7b-456d-a715-53feb6a826ba None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:30.503781 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4092bf9a-5a7b-456d-a715-53feb6a826ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:55:30.504147 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4092bf9a-5a7b-456d-a715-53feb6a826ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:30.505822 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4092bf9a-5a7b-456d-a715-53feb6a826ba None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:30.515548 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 627/1250] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 27 18:55:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:55:30.521623 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b07fdb-91c2-4220-9f48-fee7183c6d4b None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:30.611673 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:30.638509 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b07fdb-91c2-4220-9f48-fee7183c6d4b None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:30.680890 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc47f8-fb59-4245-8c12-5612e451f117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:30.681605 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc47f8-fb59-4245-8c12-5612e451f117 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:30.681894 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc47f8-fb59-4245-8c12-5612e451f117 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:30.682210 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc47f8-fb59-4245-8c12-5612e451f117 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:30.693831 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fc47f8-fb59-4245-8c12-5612e451f117 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:30.695405 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fc47f8-fb59-4245-8c12-5612e451f117 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:30.714031 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-c8fc47f8-fb59-4245-8c12-5612e451f117 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:55:30.714031 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:55:30.714031 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:55:30.714031 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:55:30.714031 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:55:30.714031 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:55:30.714031 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:55:30.714031 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:55:30.714031 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:55:30.714031 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:55:30.714031 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:55:30.714031 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:55:30.714031 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:55:30.714031 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:55:30.714031 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:55:30.715285 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:55:30.715285 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:55:30.715285 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:55:30.715285 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:55:30.715285 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:55:30.715285 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:55:30.715285 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:55:30.715285 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:55:30.715285 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:55:30.715285 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:55:30.715285 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:55:30.715285 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:55:30.715285 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:55:30.715285 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:55:30.715285 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:55:30.715285 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:55:30.715285 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:55:30.716722 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:55:30.716722 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:55:30.716722 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:55:30.716722 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:55:30.716722 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 624/1251] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:55:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:55:30.722184 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092bf9a-5a7b-456d-a715-53feb6a826ba None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:30.843853 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092bf9a-5a7b-456d-a715-53feb6a826ba None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:30.881473 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2239ca12-7782-40b8-83f7-14e9983200ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:30.882102 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239ca12-7782-40b8-83f7-14e9983200ab None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:30.882389 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239ca12-7782-40b8-83f7-14e9983200ab None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:30.882665 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239ca12-7782-40b8-83f7-14e9983200ab None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:30.883409 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2239ca12-7782-40b8-83f7-14e9983200ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:55:30.883747 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2239ca12-7782-40b8-83f7-14e9983200ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:30.885224 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2239ca12-7782-40b8-83f7-14e9983200ab None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:30.904769 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 628/1252] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:55:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:55:30.906164 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc47f8-fb59-4245-8c12-5612e451f117 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:31.027493 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc47f8-fb59-4245-8c12-5612e451f117 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:31.064403 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:31.078320 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be4921-e379-4e9c-ba36-b4af4d5659b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:31.079004 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be4921-e379-4e9c-ba36-b4af4d5659b7 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:31.079459 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be4921-e379-4e9c-ba36-b4af4d5659b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:31.079752 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be4921-e379-4e9c-ba36-b4af4d5659b7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:31.089141 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33be4921-e379-4e9c-ba36-b4af4d5659b7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:31.090749 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33be4921-e379-4e9c-ba36-b4af4d5659b7 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:31.104806 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-33be4921-e379-4e9c-ba36-b4af4d5659b7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 18:55:31.104806 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:55:31.104806 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:55:31.104806 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:55:31.104806 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:55:31.104806 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:55:31.104806 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:55:31.104806 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:55:31.104806 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:55:31.104806 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:55:31.104806 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:55:31.104806 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:55:31.104806 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:55:31.104806 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:55:31.104806 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:55:31.104806 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:55:31.106468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:55:31.106468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:55:31.106468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:55:31.106468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:55:31.106468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:55:31.106468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:55:31.106468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:55:31.106468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:55:31.106468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:55:31.106468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:55:31.106468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:55:31.106468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:55:31.106468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:55:31.106468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:55:31.106468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:55:31.106468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:55:31.106468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:55:31.106468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:55:31.107618 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:55:31.107618 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:55:31.107618 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:55:31.107618 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:55:31.107618 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:55:31.107618 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:55:31.107618 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:55:31.107618 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:55:31.107618 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 18:55:31.107618 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:55:31.107618 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 625/1253] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:55:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:55:31.112369 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2239ca12-7782-40b8-83f7-14e9983200ab None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:31.177132 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:31.229530 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2239ca12-7782-40b8-83f7-14e9983200ab None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:31.273363 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05c902-fdbf-4eff-bf5d-2b8f0719d51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:31.274137 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05c902-fdbf-4eff-bf5d-2b8f0719d51b None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:31.274448 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05c902-fdbf-4eff-bf5d-2b8f0719d51b None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:31.274741 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05c902-fdbf-4eff-bf5d-2b8f0719d51b None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:31.275649 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae05c902-fdbf-4eff-bf5d-2b8f0719d51b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:55:31.276042 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae05c902-fdbf-4eff-bf5d-2b8f0719d51b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:31.277681 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae05c902-fdbf-4eff-bf5d-2b8f0719d51b None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:31.299841 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 629/1254] 10.222.0.20 () {56 vars in 1143 bytes} [Wed Jul 27 18:55:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:55:31.306224 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be4921-e379-4e9c-ba36-b4af4d5659b7 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:31.421021 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be4921-e379-4e9c-ba36-b4af4d5659b7 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:31.463995 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c481b1ff-9fa2-4fff-9ef2-bfa9cc06b990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:31.464624 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481b1ff-9fa2-4fff-9ef2-bfa9cc06b990 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:31.464904 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481b1ff-9fa2-4fff-9ef2-bfa9cc06b990 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:31.465176 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481b1ff-9fa2-4fff-9ef2-bfa9cc06b990 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:31.529689 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:31.546210 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c481b1ff-9fa2-4fff-9ef2-bfa9cc06b990 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:31.547657 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c481b1ff-9fa2-4fff-9ef2-bfa9cc06b990 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:31.656840 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 626/1255] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 27 18:55:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 18:55:31.662706 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05c902-fdbf-4eff-bf5d-2b8f0719d51b None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:31.776827 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05c902-fdbf-4eff-bf5d-2b8f0719d51b None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:31.790940 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:31.814830 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db2b21-98eb-4c23-a755-e24a4c41f0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:31.815472 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db2b21-98eb-4c23-a755-e24a4c41f0f2 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:31.815785 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db2b21-98eb-4c23-a755-e24a4c41f0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:31.816061 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db2b21-98eb-4c23-a755-e24a4c41f0f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:31.827210 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93db2b21-98eb-4c23-a755-e24a4c41f0f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:31.828877 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93db2b21-98eb-4c23-a755-e24a4c41f0f2 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:31.845532 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-93db2b21-98eb-4c23-a755-e24a4c41f0f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:55:31.845532 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:55:31.845532 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:55:31.845532 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:55:31.845532 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:55:31.845532 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:55:31.845532 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:55:31.845532 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:55:31.845532 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:55:31.845532 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:55:31.845532 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:55:31.845532 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:55:31.845532 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:55:31.845532 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:55:31.845532 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:55:31.846690 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:55:31.846690 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:55:31.846690 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:55:31.846690 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:55:31.846690 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:55:31.846690 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:55:31.846690 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:55:31.846690 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:55:31.846690 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:55:31.846690 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:55:31.846690 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:55:31.846690 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:55:31.846690 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:55:31.846690 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:55:31.846690 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:55:31.846690 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:55:31.846690 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:55:31.847855 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:55:31.847855 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:55:31.847855 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:55:31.847855 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:55:31.847855 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 630/1256] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:55:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:55:31.852698 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c481b1ff-9fa2-4fff-9ef2-bfa9cc06b990 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:31.947329 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:31.962195 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c481b1ff-9fa2-4fff-9ef2-bfa9cc06b990 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:31.996748 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619a6c2-463b-436d-a2dd-91a1f7ea07a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:31.997984 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619a6c2-463b-436d-a2dd-91a1f7ea07a9 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:31.998249 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619a6c2-463b-436d-a2dd-91a1f7ea07a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:31.998518 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619a6c2-463b-436d-a2dd-91a1f7ea07a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:31.999196 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0619a6c2-463b-436d-a2dd-91a1f7ea07a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:55:31.999496 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0619a6c2-463b-436d-a2dd-91a1f7ea07a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:32.000891 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0619a6c2-463b-436d-a2dd-91a1f7ea07a9 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:32.011956 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 627/1257] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:55:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:55:32.017917 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db2b21-98eb-4c23-a755-e24a4c41f0f2 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:32.125831 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db2b21-98eb-4c23-a755-e24a4c41f0f2 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:32.161118 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2887810-12b6-472a-98ed-38af18a506d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:32.161751 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2887810-12b6-472a-98ed-38af18a506d8 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:32.162027 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2887810-12b6-472a-98ed-38af18a506d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:32.162299 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2887810-12b6-472a-98ed-38af18a506d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:32.170397 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2887810-12b6-472a-98ed-38af18a506d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:32.171850 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2887810-12b6-472a-98ed-38af18a506d8 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:32.185873 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-a2887810-12b6-472a-98ed-38af18a506d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:55:32.185873 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:55:32.185873 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:55:32.185873 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:55:32.185873 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:55:32.185873 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:55:32.185873 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:55:32.185873 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:55:32.185873 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:55:32.185873 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:55:32.185873 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:55:32.185873 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:55:32.185873 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:55:32.185873 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:55:32.185873 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:55:32.187014 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:55:32.187014 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:55:32.187014 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:55:32.187014 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:55:32.187014 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:55:32.187014 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:55:32.187014 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:55:32.187014 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:55:32.187014 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:55:32.187014 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:55:32.187014 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:55:32.187014 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:55:32.187014 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:55:32.187014 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:55:32.187014 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:55:32.187014 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:55:32.187014 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:55:32.188416 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:55:32.188416 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:55:32.188416 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:55:32.188416 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:55:32.188416 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:55:32.188416 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:55:32.188416 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:55:32.188416 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:55:32.188416 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 631/1258] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 27 18:55:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:55:32.193513 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619a6c2-463b-436d-a2dd-91a1f7ea07a9 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:32.305924 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619a6c2-463b-436d-a2dd-91a1f7ea07a9 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:32.341871 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa680bc-da8e-4d0d-8f5c-6e69c4bd4f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:32.342563 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa680bc-da8e-4d0d-8f5c-6e69c4bd4f31 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:32.342831 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa680bc-da8e-4d0d-8f5c-6e69c4bd4f31 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:32.343130 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa680bc-da8e-4d0d-8f5c-6e69c4bd4f31 None admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:32.343922 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa680bc-da8e-4d0d-8f5c-6e69c4bd4f31 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:55:32.344265 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa680bc-da8e-4d0d-8f5c-6e69c4bd4f31 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:32.345825 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa680bc-da8e-4d0d-8f5c-6e69c4bd4f31 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:32.359208 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 628/1259] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 27 18:55:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:55:32.365453 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2887810-12b6-472a-98ed-38af18a506d8 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:32.391958 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:32.473054 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2887810-12b6-472a-98ed-38af18a506d8 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:32.508967 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c71cb85-90d1-43b3-bffb-77eb26726c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:32.509571 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71cb85-90d1-43b3-bffb-77eb26726c9d None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:32.509854 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71cb85-90d1-43b3-bffb-77eb26726c9d None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:32.510130 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71cb85-90d1-43b3-bffb-77eb26726c9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:32.510917 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c71cb85-90d1-43b3-bffb-77eb26726c9d None admin] RBAC: Adding query filter params (role.id=0f4a39b061e148418413cfe647af9a34, scope.project.id=31f027c53398443eb548eaf3f24523e0, user.id=3b0382b170fb49e785a57bbb329d4b37) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:55:32.511229 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c71cb85-90d1-43b3-bffb-77eb26726c9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:32.512766 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c71cb85-90d1-43b3-bffb-77eb26726c9d None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:32.519193 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 632/1260] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 27 18:55:32 2022] GET /identity/v3/role_assignments?user.id=3b0382b170fb49e785a57bbb329d4b37&scope.project.id=31f027c53398443eb548eaf3f24523e0&role.id=0f4a39b061e148418413cfe647af9a34 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:55:34.539417 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d44529-8394-4445-aee3-0e1fbbd50900 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:34.539936 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d44529-8394-4445-aee3-0e1fbbd50900 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:34.540024 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d44529-8394-4445-aee3-0e1fbbd50900 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:34.541341 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 629/1261] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:55:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:55:34.547082 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0708bf-45c8-4063-a7b8-b79ff00c4f47 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:34.547499 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0708bf-45c8-4063-a7b8-b79ff00c4f47 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:34.547639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0708bf-45c8-4063-a7b8-b79ff00c4f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:34.565313 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-1f0708bf-45c8-4063-a7b8-b79ff00c4f47 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:55:34.566489 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-1f0708bf-45c8-4063-a7b8-b79ff00c4f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:34.630772 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 633/1262] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:55:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:55:34.652566 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d44529-8394-4445-aee3-0e1fbbd50900 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:34.663714 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:34.754327 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d44529-8394-4445-aee3-0e1fbbd50900 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:34.786267 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43225938-cbf8-4fdb-8717-da08ceec13ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:34.786834 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43225938-cbf8-4fdb-8717-da08ceec13ae None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:34.787114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43225938-cbf8-4fdb-8717-da08ceec13ae None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:34.787387 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43225938-cbf8-4fdb-8717-da08ceec13ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:34.797945 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43225938-cbf8-4fdb-8717-da08ceec13ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:55:34.802789 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-43225938-cbf8-4fdb-8717-da08ceec13ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:55:34.802789 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:55:34.802789 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:55:34.802789 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:55:34.802789 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:55:34.802789 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:55:34.802789 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:55:34.802789 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:55:34.802789 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:55:34.802789 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:55:34.802789 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:55:34.802789 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:55:34.802789 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:55:34.802789 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:55:34.802789 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:55:34.802789 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:55:34.803878 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:55:34.803878 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:55:34.803878 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:55:34.803878 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:55:34.803878 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:55:34.803878 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:55:34.803878 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:55:34.803878 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:55:34.803878 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:55:34.803878 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:55:34.803878 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:55:34.803878 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:55:34.803878 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:55:34.803878 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:55:34.803878 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:55:34.803878 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:55:34.804762 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:55:34.804762 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:55:34.804762 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:55:34.804762 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:55:34.804762 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:55:34.804762 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:55:34.804762 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:55:34.804762 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:55:34.804762 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:55:34.804762 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:55:34.804762 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:55:34.804762 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:55:34.804762 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 630/1263] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 27 18:55:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:55:34.810371 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0708bf-45c8-4063-a7b8-b79ff00c4f47 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:34.828151 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:34.907955 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0708bf-45c8-4063-a7b8-b79ff00c4f47 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:34.941165 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e2c092-7d5e-4aad-ac2c-86e8b41c433a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:34.941769 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2c092-7d5e-4aad-ac2c-86e8b41c433a None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:34.942045 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2c092-7d5e-4aad-ac2c-86e8b41c433a None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:34.942315 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2c092-7d5e-4aad-ac2c-86e8b41c433a None admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:34.943019 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e2c092-7d5e-4aad-ac2c-86e8b41c433a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:55:34.943319 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e2c092-7d5e-4aad-ac2c-86e8b41c433a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:34.944689 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e2c092-7d5e-4aad-ac2c-86e8b41c433a None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:34.952548 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 634/1264] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 27 18:55:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:55:34.958271 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43225938-cbf8-4fdb-8717-da08ceec13ae None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:35.022376 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:35.054394 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43225938-cbf8-4fdb-8717-da08ceec13ae None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:35.086709 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46808d6c-c5b0-45c4-99c9-80647f5172e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:35.087325 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46808d6c-c5b0-45c4-99c9-80647f5172e3 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:35.087604 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46808d6c-c5b0-45c4-99c9-80647f5172e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:35.087903 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46808d6c-c5b0-45c4-99c9-80647f5172e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:35.097916 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46808d6c-c5b0-45c4-99c9-80647f5172e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:35.099330 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46808d6c-c5b0-45c4-99c9-80647f5172e3 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:35.114050 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-46808d6c-c5b0-45c4-99c9-80647f5172e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:55:35.114050 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:55:35.114050 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:55:35.114050 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:55:35.114050 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:55:35.114050 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:55:35.114050 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:55:35.114050 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:55:35.114050 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:55:35.114050 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:55:35.114050 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:55:35.114050 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:55:35.114050 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:55:35.114050 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:55:35.114050 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:55:35.114916 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:55:35.114916 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:55:35.114916 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:55:35.114916 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:55:35.114916 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:55:35.114916 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:55:35.114916 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:55:35.114916 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:55:35.114916 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:55:35.114916 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:55:35.114916 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:55:35.114916 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:55:35.114916 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:55:35.114916 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:55:35.114916 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:55:35.114916 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:55:35.114916 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:55:35.115866 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:55:35.115866 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:55:35.115866 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:55:35.115866 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:55:35.115866 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 631/1265] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:55:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:55:35.120730 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e2c092-7d5e-4aad-ac2c-86e8b41c433a None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:35.197768 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:35.217123 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e2c092-7d5e-4aad-ac2c-86e8b41c433a None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:35.252279 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56e43b9-06f9-481a-88be-86a48d2b703f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:35.252895 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e43b9-06f9-481a-88be-86a48d2b703f None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:35.253206 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e43b9-06f9-481a-88be-86a48d2b703f None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:35.253454 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e43b9-06f9-481a-88be-86a48d2b703f None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:35.254247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56e43b9-06f9-481a-88be-86a48d2b703f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:55:35.254635 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56e43b9-06f9-481a-88be-86a48d2b703f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:35.256135 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56e43b9-06f9-481a-88be-86a48d2b703f None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:35.268859 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 635/1266] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:55:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:55:35.277125 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46808d6c-c5b0-45c4-99c9-80647f5172e3 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:35.382240 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46808d6c-c5b0-45c4-99c9-80647f5172e3 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:35.401276 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:35.414812 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9d777-424f-453c-97f8-4b4ad4406919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:35.415433 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9d777-424f-453c-97f8-4b4ad4406919 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:35.415738 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9d777-424f-453c-97f8-4b4ad4406919 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:35.416014 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9d777-424f-453c-97f8-4b4ad4406919 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:35.423588 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a9d777-424f-453c-97f8-4b4ad4406919 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:35.425036 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a9d777-424f-453c-97f8-4b4ad4406919 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:35.436535 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-a9a9d777-424f-453c-97f8-4b4ad4406919 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 18:55:35.436535 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:55:35.436535 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:55:35.436535 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:55:35.436535 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:55:35.436535 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:55:35.436535 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:55:35.436535 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:55:35.436535 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:55:35.436535 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:55:35.436535 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:55:35.436535 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:55:35.436535 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:55:35.436535 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:55:35.436535 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:55:35.436535 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:55:35.437639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:55:35.437639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:55:35.437639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:55:35.437639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:55:35.437639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:55:35.437639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:55:35.437639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:55:35.437639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:55:35.437639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:55:35.437639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:55:35.437639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:55:35.437639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:55:35.437639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:55:35.437639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:55:35.437639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:55:35.437639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:55:35.437639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:55:35.437639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:55:35.438992 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:55:35.438992 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:55:35.438992 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:55:35.438992 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:55:35.438992 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:55:35.438992 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:55:35.438992 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:55:35.438992 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:55:35.438992 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 18:55:35.438992 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:55:35.438992 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 632/1267] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:55:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:55:35.443484 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56e43b9-06f9-481a-88be-86a48d2b703f None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:35.538141 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56e43b9-06f9-481a-88be-86a48d2b703f None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:35.571104 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf14f78-5cd7-4ed8-b2ed-a903f3e8f228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:35.571713 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf14f78-5cd7-4ed8-b2ed-a903f3e8f228 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:35.571985 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf14f78-5cd7-4ed8-b2ed-a903f3e8f228 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:35.572253 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf14f78-5cd7-4ed8-b2ed-a903f3e8f228 None admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:35.573026 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf14f78-5cd7-4ed8-b2ed-a903f3e8f228 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:55:35.573328 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf14f78-5cd7-4ed8-b2ed-a903f3e8f228 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:35.574724 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf14f78-5cd7-4ed8-b2ed-a903f3e8f228 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:35.582974 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:35.592114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 636/1268] 10.222.0.20 () {56 vars in 1143 bytes} [Wed Jul 27 18:55:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:55:35.597743 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9d777-424f-453c-97f8-4b4ad4406919 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:35.694682 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9d777-424f-453c-97f8-4b4ad4406919 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:35.726081 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db2ce55-60bb-488a-942f-f0667c63d946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:35.726691 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db2ce55-60bb-488a-942f-f0667c63d946 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:35.726966 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db2ce55-60bb-488a-942f-f0667c63d946 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:35.727232 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db2ce55-60bb-488a-942f-f0667c63d946 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:35.738028 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db2ce55-60bb-488a-942f-f0667c63d946 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:35.739433 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db2ce55-60bb-488a-942f-f0667c63d946 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:35.753446 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-3db2ce55-60bb-488a-942f-f0667c63d946 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:55:35.753446 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:55:35.753446 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:55:35.753446 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:55:35.753446 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:55:35.753446 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:55:35.753446 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:55:35.753446 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:55:35.753446 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:55:35.753446 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:55:35.753446 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:55:35.753446 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:55:35.753446 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:55:35.753446 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:55:35.753446 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:55:35.754480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:55:35.754480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:55:35.754480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:55:35.754480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:55:35.754480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:55:35.754480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:55:35.754480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:55:35.754480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:55:35.754480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:55:35.754480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:55:35.754480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:55:35.754480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:55:35.754480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:55:35.754480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:55:35.754480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:55:35.754480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:55:35.754480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:55:35.755779 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:55:35.755779 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:55:35.755779 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:55:35.755779 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:55:35.755779 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 633/1269] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:55:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:55:35.760127 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf14f78-5cd7-4ed8-b2ed-a903f3e8f228 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:35.854638 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf14f78-5cd7-4ed8-b2ed-a903f3e8f228 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:35.887431 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2d84b-f86c-46c0-a9d4-4548eeead32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:35.888115 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2d84b-f86c-46c0-a9d4-4548eeead32e None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:35.888390 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2d84b-f86c-46c0-a9d4-4548eeead32e None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:35.888658 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2d84b-f86c-46c0-a9d4-4548eeead32e None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:35.889330 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d2d84b-f86c-46c0-a9d4-4548eeead32e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:55:35.889629 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d2d84b-f86c-46c0-a9d4-4548eeead32e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:35.890957 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d2d84b-f86c-46c0-a9d4-4548eeead32e None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:35.901682 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 637/1270] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:55:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:55:35.907784 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db2ce55-60bb-488a-942f-f0667c63d946 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:35.937893 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:36.002976 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db2ce55-60bb-488a-942f-f0667c63d946 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:36.035353 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d10a9b3-c844-40ca-aa40-c022a20ab791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:36.036026 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10a9b3-c844-40ca-aa40-c022a20ab791 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:36.036404 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10a9b3-c844-40ca-aa40-c022a20ab791 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:36.036698 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10a9b3-c844-40ca-aa40-c022a20ab791 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:36.046672 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d10a9b3-c844-40ca-aa40-c022a20ab791 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:36.048274 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d10a9b3-c844-40ca-aa40-c022a20ab791 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:36.059394 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-9d10a9b3-c844-40ca-aa40-c022a20ab791 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:55:36.059394 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:55:36.059394 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:55:36.059394 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:55:36.059394 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:55:36.059394 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:55:36.059394 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:55:36.059394 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:55:36.059394 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:55:36.059394 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:55:36.059394 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:55:36.059394 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:55:36.059394 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:55:36.059394 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:55:36.059394 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:55:36.060480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:55:36.060480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:55:36.060480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:55:36.060480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:55:36.060480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:55:36.060480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:55:36.060480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:55:36.060480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:55:36.060480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:55:36.060480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:55:36.060480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:55:36.060480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:55:36.060480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:55:36.060480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:55:36.060480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:55:36.060480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:55:36.060480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:55:36.061561 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:55:36.061561 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:55:36.061561 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:55:36.061561 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:55:36.061561 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:55:36.061561 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:55:36.061561 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:55:36.061561 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:55:36.061561 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 634/1271] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 27 18:55:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:55:36.066307 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2d84b-f86c-46c0-a9d4-4548eeead32e None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:36.125722 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:36.168812 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2d84b-f86c-46c0-a9d4-4548eeead32e None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:36.201489 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26740ee-473a-4645-adcf-e05d3bfcca33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:36.202089 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26740ee-473a-4645-adcf-e05d3bfcca33 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:36.202370 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26740ee-473a-4645-adcf-e05d3bfcca33 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:36.202645 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26740ee-473a-4645-adcf-e05d3bfcca33 None admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:36.203385 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26740ee-473a-4645-adcf-e05d3bfcca33 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:55:36.203724 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26740ee-473a-4645-adcf-e05d3bfcca33 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:36.205139 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26740ee-473a-4645-adcf-e05d3bfcca33 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:36.217227 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 638/1272] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 27 18:55:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:55:36.223204 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d10a9b3-c844-40ca-aa40-c022a20ab791 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:36.318820 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:36.327989 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d10a9b3-c844-40ca-aa40-c022a20ab791 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:36.360424 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a45f31-b0ff-4586-8eba-eafc06e70a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:36.361079 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a45f31-b0ff-4586-8eba-eafc06e70a45 None admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:36.361359 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a45f31-b0ff-4586-8eba-eafc06e70a45 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:36.361632 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a45f31-b0ff-4586-8eba-eafc06e70a45 None admin] PATH_INFO: `/v3/projects/31f027c53398443eb548eaf3f24523e0/users/3b0382b170fb49e785a57bbb329d4b37/roles/0f4a39b061e148418413cfe647af9a34` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:36.363524 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a45f31-b0ff-4586-8eba-eafc06e70a45 None admin] RBAC: Authorizing `identity:create_grant(project_id=31f027c53398443eb548eaf3f24523e0, user_id=3b0382b170fb49e785a57bbb329d4b37, role_id=0f4a39b061e148418413cfe647af9a34)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:36.365035 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a45f31-b0ff-4586-8eba-eafc06e70a45 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:36.376666 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 635/1273] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 27 18:55:36 2022] PUT /identity/v3/projects/31f027c53398443eb548eaf3f24523e0/users/3b0382b170fb49e785a57bbb329d4b37/roles/0f4a39b061e148418413cfe647af9a34 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:55:38.365115 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc563fa5-ff87-4665-a484-24933ea9d87d None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:38.365675 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc563fa5-ff87-4665-a484-24933ea9d87d None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:38.365675 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc563fa5-ff87-4665-a484-24933ea9d87d None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:38.367017 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 639/1274] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:55:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:55:38.372073 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108cd669-3d9b-4e67-abe9-73eae73833e2 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:38.372496 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108cd669-3d9b-4e67-abe9-73eae73833e2 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:38.372631 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108cd669-3d9b-4e67-abe9-73eae73833e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:38.390109 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-108cd669-3d9b-4e67-abe9-73eae73833e2 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:55:38.391283 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-108cd669-3d9b-4e67-abe9-73eae73833e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:38.455389 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 636/1275] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:55:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:55:38.481031 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc563fa5-ff87-4665-a484-24933ea9d87d None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:38.580316 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc563fa5-ff87-4665-a484-24933ea9d87d None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:38.596845 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:38.614085 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4521e053-1b84-4141-b60a-f6ea2045a892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:38.614712 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521e053-1b84-4141-b60a-f6ea2045a892 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:38.614996 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521e053-1b84-4141-b60a-f6ea2045a892 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:38.615320 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521e053-1b84-4141-b60a-f6ea2045a892 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:38.625658 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4521e053-1b84-4141-b60a-f6ea2045a892 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:55:38.630530 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-4521e053-1b84-4141-b60a-f6ea2045a892 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:55:38.630530 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:55:38.630530 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:55:38.630530 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:55:38.630530 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:55:38.630530 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:55:38.630530 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:55:38.630530 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:55:38.630530 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:55:38.630530 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:55:38.630530 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:55:38.630530 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:55:38.630530 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:55:38.630530 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:55:38.630530 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:55:38.630530 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:55:38.631625 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:55:38.631625 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:55:38.631625 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:55:38.631625 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:55:38.631625 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:55:38.631625 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:55:38.631625 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:55:38.631625 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:55:38.631625 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:55:38.631625 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:55:38.631625 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:55:38.631625 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:55:38.631625 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:55:38.631625 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:55:38.631625 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:55:38.631625 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:55:38.632734 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:55:38.632734 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:55:38.632734 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:55:38.632734 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:55:38.632734 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:55:38.632734 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:55:38.632734 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:55:38.632734 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:55:38.632734 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:55:38.632734 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:55:38.632734 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:55:38.632734 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:55:38.632734 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 640/1276] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 27 18:55:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:55:38.637676 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108cd669-3d9b-4e67-abe9-73eae73833e2 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:38.713488 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:38.732743 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108cd669-3d9b-4e67-abe9-73eae73833e2 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:38.764987 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa4f45-b964-47a1-a1f7-a70480f5cbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:38.765581 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa4f45-b964-47a1-a1f7-a70480f5cbd6 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:38.765858 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa4f45-b964-47a1-a1f7-a70480f5cbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:38.766125 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa4f45-b964-47a1-a1f7-a70480f5cbd6 None admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:38.766826 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaa4f45-b964-47a1-a1f7-a70480f5cbd6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:55:38.767122 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaa4f45-b964-47a1-a1f7-a70480f5cbd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:38.768490 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaa4f45-b964-47a1-a1f7-a70480f5cbd6 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:38.776120 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 637/1277] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 27 18:55:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:55:38.781653 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4521e053-1b84-4141-b60a-f6ea2045a892 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:38.877849 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4521e053-1b84-4141-b60a-f6ea2045a892 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:38.909925 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055adde7-8861-4fd5-863b-4019f5067b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:38.910532 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055adde7-8861-4fd5-863b-4019f5067b9b None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:38.910809 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055adde7-8861-4fd5-863b-4019f5067b9b None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:38.911086 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055adde7-8861-4fd5-863b-4019f5067b9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:38.920753 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055adde7-8861-4fd5-863b-4019f5067b9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:38.922184 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055adde7-8861-4fd5-863b-4019f5067b9b None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:38.936995 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-055adde7-8861-4fd5-863b-4019f5067b9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:55:38.936995 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:55:38.936995 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:55:38.936995 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:55:38.936995 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:55:38.936995 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:55:38.936995 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:55:38.936995 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:55:38.936995 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:55:38.936995 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:55:38.936995 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:55:38.936995 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:55:38.936995 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:55:38.936995 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:55:38.936995 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:55:38.938017 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:55:38.938017 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:55:38.938017 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:55:38.938017 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:55:38.938017 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:55:38.938017 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:55:38.938017 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:55:38.938017 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:55:38.938017 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:55:38.938017 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:55:38.938017 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:55:38.938017 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:55:38.938017 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:55:38.938017 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:55:38.938017 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:55:38.938017 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:55:38.938017 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:55:38.939367 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:55:38.939367 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:55:38.939367 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:55:38.939367 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:55:38.939367 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 641/1278] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:55:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:55:38.943806 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa4f45-b964-47a1-a1f7-a70480f5cbd6 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:39.039153 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa4f45-b964-47a1-a1f7-a70480f5cbd6 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:39.070649 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f4bb2-318e-48ea-b6e4-09795f936cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:39.071236 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f4bb2-318e-48ea-b6e4-09795f936cbb None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:39.071510 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f4bb2-318e-48ea-b6e4-09795f936cbb None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:39.071803 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f4bb2-318e-48ea-b6e4-09795f936cbb None admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:39.072478 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4f4bb2-318e-48ea-b6e4-09795f936cbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:55:39.072774 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4f4bb2-318e-48ea-b6e4-09795f936cbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:39.074105 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4f4bb2-318e-48ea-b6e4-09795f936cbb None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:39.085732 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 638/1279] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:55:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:55:39.091255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055adde7-8861-4fd5-863b-4019f5067b9b None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:39.121713 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:39.191254 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055adde7-8861-4fd5-863b-4019f5067b9b None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:39.222543 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb83612-b5c9-4905-b083-8c96f11ad56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:39.223160 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb83612-b5c9-4905-b083-8c96f11ad56d None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:39.223445 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb83612-b5c9-4905-b083-8c96f11ad56d None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:39.223734 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb83612-b5c9-4905-b083-8c96f11ad56d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:39.231630 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb83612-b5c9-4905-b083-8c96f11ad56d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:39.233084 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb83612-b5c9-4905-b083-8c96f11ad56d None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:39.244040 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-bfb83612-b5c9-4905-b083-8c96f11ad56d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 18:55:39.244040 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:55:39.244040 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:55:39.244040 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:55:39.244040 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:55:39.244040 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:55:39.244040 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:55:39.244040 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:55:39.244040 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:55:39.244040 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:55:39.244040 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:55:39.244040 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:55:39.244040 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:55:39.244040 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:55:39.244040 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:55:39.244040 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:55:39.245206 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:55:39.245206 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:55:39.245206 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:55:39.245206 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:55:39.245206 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:55:39.245206 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:55:39.245206 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:55:39.245206 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:55:39.245206 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:55:39.245206 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:55:39.245206 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:55:39.245206 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:55:39.245206 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:55:39.245206 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:55:39.245206 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:55:39.245206 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:55:39.245206 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:55:39.245206 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:55:39.246364 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:55:39.246364 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:55:39.246364 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:55:39.246364 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:55:39.246364 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:55:39.246364 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:55:39.246364 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:55:39.246364 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:55:39.246364 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 18:55:39.246364 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:55:39.246364 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 642/1280] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:55:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:55:39.251776 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f4bb2-318e-48ea-b6e4-09795f936cbb None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:39.256085 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:39.349175 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f4bb2-318e-48ea-b6e4-09795f936cbb None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:39.381902 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a23c5f-6c98-42c4-b899-8f5d3ff3f319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:39.382509 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a23c5f-6c98-42c4-b899-8f5d3ff3f319 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:39.382765 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a23c5f-6c98-42c4-b899-8f5d3ff3f319 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:39.383028 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a23c5f-6c98-42c4-b899-8f5d3ff3f319 None admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:39.383837 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a23c5f-6c98-42c4-b899-8f5d3ff3f319 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:55:39.384138 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a23c5f-6c98-42c4-b899-8f5d3ff3f319 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:39.385531 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a23c5f-6c98-42c4-b899-8f5d3ff3f319 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:39.401582 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 639/1281] 10.222.0.20 () {56 vars in 1143 bytes} [Wed Jul 27 18:55:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:55:39.407311 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb83612-b5c9-4905-b083-8c96f11ad56d None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:39.494464 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:39.506753 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb83612-b5c9-4905-b083-8c96f11ad56d None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:39.539885 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc6e608-8922-4c03-b0af-27558ea955f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:39.540495 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6e608-8922-4c03-b0af-27558ea955f4 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:39.540771 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6e608-8922-4c03-b0af-27558ea955f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:39.541037 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6e608-8922-4c03-b0af-27558ea955f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:39.607052 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc6e608-8922-4c03-b0af-27558ea955f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:39.608515 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc6e608-8922-4c03-b0af-27558ea955f4 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:39.692225 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:39.702346 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 643/1282] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 27 18:55:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 18:55:39.708125 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a23c5f-6c98-42c4-b899-8f5d3ff3f319 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:39.767564 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:39.805373 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a23c5f-6c98-42c4-b899-8f5d3ff3f319 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:39.837217 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e4bb3-61e6-47f0-876c-49778e2f41e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:39.837841 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e4bb3-61e6-47f0-876c-49778e2f41e7 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:39.838122 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e4bb3-61e6-47f0-876c-49778e2f41e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:39.838397 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e4bb3-61e6-47f0-876c-49778e2f41e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:39.848614 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352e4bb3-61e6-47f0-876c-49778e2f41e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:39.850083 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352e4bb3-61e6-47f0-876c-49778e2f41e7 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:39.866075 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-352e4bb3-61e6-47f0-876c-49778e2f41e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:55:39.866075 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:55:39.866075 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:55:39.866075 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:55:39.866075 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:55:39.866075 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:55:39.866075 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:55:39.866075 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:55:39.866075 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:55:39.866075 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:55:39.866075 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:55:39.866075 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:55:39.866075 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:55:39.866075 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:55:39.866075 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:55:39.867010 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:55:39.867010 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:55:39.867010 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:55:39.867010 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:55:39.867010 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:55:39.867010 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:55:39.867010 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:55:39.867010 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:55:39.867010 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:55:39.867010 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:55:39.867010 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:55:39.867010 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:55:39.867010 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:55:39.867010 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:55:39.867010 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:55:39.867010 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:55:39.867010 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:55:39.867957 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:55:39.867957 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:55:39.867957 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:55:39.867957 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:55:39.867957 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 640/1283] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:55:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:55:39.873021 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc6e608-8922-4c03-b0af-27558ea955f4 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:39.967943 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc6e608-8922-4c03-b0af-27558ea955f4 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:39.999905 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4675bb6b-b659-4d51-bcad-5e385cc3cb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:40.000496 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675bb6b-b659-4d51-bcad-5e385cc3cb5f None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:40.000773 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675bb6b-b659-4d51-bcad-5e385cc3cb5f None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:40.001041 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675bb6b-b659-4d51-bcad-5e385cc3cb5f None admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:40.001710 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4675bb6b-b659-4d51-bcad-5e385cc3cb5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:55:40.002011 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4675bb6b-b659-4d51-bcad-5e385cc3cb5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:40.003343 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4675bb6b-b659-4d51-bcad-5e385cc3cb5f None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:40.014622 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 644/1284] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 27 18:55:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:55:40.020494 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e4bb3-61e6-47f0-876c-49778e2f41e7 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:40.116821 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e4bb3-61e6-47f0-876c-49778e2f41e7 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:40.130201 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:40.154510 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66616a8-6b04-499e-a751-e3a2787ead40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:40.155180 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66616a8-6b04-499e-a751-e3a2787ead40 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:40.155467 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66616a8-6b04-499e-a751-e3a2787ead40 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:40.155769 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66616a8-6b04-499e-a751-e3a2787ead40 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:40.162240 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66616a8-6b04-499e-a751-e3a2787ead40 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:40.163652 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66616a8-6b04-499e-a751-e3a2787ead40 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:40.175973 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application [None req-a66616a8-6b04-499e-a751-e3a2787ead40 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:55:40.175973 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:55:40.175973 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:55:40.175973 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:55:40.175973 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:55:40.175973 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:55:40.175973 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:55:40.175973 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:55:40.175973 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:55:40.175973 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:55:40.175973 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:55:40.175973 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:55:40.175973 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:55:40.175973 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:55:40.175973 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:55:40.177026 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:55:40.177026 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:55:40.177026 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:55:40.177026 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:55:40.177026 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:55:40.177026 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:55:40.177026 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:55:40.177026 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:55:40.177026 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application with Lock( Jul 27 18:55:40.177026 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:55:40.177026 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:55:40.177026 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:55:40.177026 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:55:40.177026 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:55:40.177026 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:55:40.177026 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:55:40.177026 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:55:40.178331 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:55:40.178331 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:55:40.178331 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:55:40.178331 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:55:40.178331 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:55:40.178331 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:55:40.178331 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:55:40.178331 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: ERROR keystone.server.flask.application Jul 27 18:55:40.178331 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 641/1285] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 27 18:55:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:55:40.182908 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4675bb6b-b659-4d51-bcad-5e385cc3cb5f None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:40.231384 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:40.284290 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4675bb6b-b659-4d51-bcad-5e385cc3cb5f None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:40.315873 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac07b990-0cba-44ca-a745-f27027ba5de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:40.316468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07b990-0cba-44ca-a745-f27027ba5de5 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:40.316744 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07b990-0cba-44ca-a745-f27027ba5de5 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:40.317013 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07b990-0cba-44ca-a745-f27027ba5de5 None admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:40.317736 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac07b990-0cba-44ca-a745-f27027ba5de5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:55:40.318039 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac07b990-0cba-44ca-a745-f27027ba5de5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:40.319442 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac07b990-0cba-44ca-a745-f27027ba5de5 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:40.332195 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 645/1286] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 27 18:55:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:55:40.338296 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66616a8-6b04-499e-a751-e3a2787ead40 None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:40.434763 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66616a8-6b04-499e-a751-e3a2787ead40 None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:40.466817 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695335ec-6136-46be-afab-68fab62ac327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:40.467398 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695335ec-6136-46be-afab-68fab62ac327 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:40.467673 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695335ec-6136-46be-afab-68fab62ac327 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:40.467972 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695335ec-6136-46be-afab-68fab62ac327 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:40.468742 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695335ec-6136-46be-afab-68fab62ac327 None admin] RBAC: Adding query filter params (role.id=0f4a39b061e148418413cfe647af9a34, scope.project.id=31f027c53398443eb548eaf3f24523e0, user.id=3b0382b170fb49e785a57bbb329d4b37) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:55:40.469047 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695335ec-6136-46be-afab-68fab62ac327 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:40.470451 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695335ec-6136-46be-afab-68fab62ac327 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:40.475994 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 642/1287] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 27 18:55:40 2022] GET /identity/v3/role_assignments?user.id=3b0382b170fb49e785a57bbb329d4b37&scope.project.id=31f027c53398443eb548eaf3f24523e0&role.id=0f4a39b061e148418413cfe647af9a34 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:55:42.468723 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6e92a-c0ff-433b-8afa-699af5a274da None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:42.469261 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6e92a-c0ff-433b-8afa-699af5a274da None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:42.469261 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6e92a-c0ff-433b-8afa-699af5a274da None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:42.471821 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 646/1288] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:55:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:55:42.477055 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592b933-8c64-4e8a-9f11-4dfb089ce4c8 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:42.477473 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592b933-8c64-4e8a-9f11-4dfb089ce4c8 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:42.477599 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592b933-8c64-4e8a-9f11-4dfb089ce4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:42.496104 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-7592b933-8c64-4e8a-9f11-4dfb089ce4c8 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:55:42.497949 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-7592b933-8c64-4e8a-9f11-4dfb089ce4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:42.525949 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:42.563566 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 643/1289] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:55:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:55:42.584464 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd6e92a-c0ff-433b-8afa-699af5a274da None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:42.683842 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd6e92a-c0ff-433b-8afa-699af5a274da None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:42.694691 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:42.717751 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279319bf-f81a-4754-afd5-2fe0c71f9562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:42.718375 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279319bf-f81a-4754-afd5-2fe0c71f9562 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:42.718659 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279319bf-f81a-4754-afd5-2fe0c71f9562 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:42.718988 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279319bf-f81a-4754-afd5-2fe0c71f9562 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:42.719555 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279319bf-f81a-4754-afd5-2fe0c71f9562 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:42.720986 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279319bf-f81a-4754-afd5-2fe0c71f9562 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:42.729592 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-279319bf-f81a-4754-afd5-2fe0c71f9562 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 18:55:42.729592 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:55:42.729592 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:55:42.729592 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:55:42.729592 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:55:42.729592 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:55:42.729592 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:55:42.729592 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:55:42.729592 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 18:55:42.729592 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:55:42.729592 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:55:42.729592 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:55:42.729592 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:55:42.729592 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:55:42.729592 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:55:42.729592 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:55:42.729592 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:55:42.731230 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:55:42.731230 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:55:42.731230 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:55:42.731230 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:55:42.731230 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:55:42.731230 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:55:42.731230 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:55:42.731230 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:55:42.731230 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:55:42.731230 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:55:42.731230 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:55:42.731230 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:55:42.731230 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:55:42.731230 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:55:42.731230 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:55:42.731230 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:55:42.732477 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:55:42.732477 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:55:42.732477 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:55:42.732477 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:55:42.732477 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:55:42.732477 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:55:42.732477 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:55:42.732477 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:55:42.732477 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:55:42.732477 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:55:42.732477 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:55:42.732477 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:55:42.732477 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 18:55:42.732477 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:55:42.732477 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 647/1290] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Jul 27 18:55:42 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:55:42.737434 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7592b933-8c64-4e8a-9f11-4dfb089ce4c8 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:42.833594 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7592b933-8c64-4e8a-9f11-4dfb089ce4c8 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:42.866594 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285bea10-6129-490a-b0cf-fdf0135969d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:42.867189 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285bea10-6129-490a-b0cf-fdf0135969d6 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:42.867462 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285bea10-6129-490a-b0cf-fdf0135969d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:42.867753 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285bea10-6129-490a-b0cf-fdf0135969d6 None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:42.868417 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285bea10-6129-490a-b0cf-fdf0135969d6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:55:42.868716 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285bea10-6129-490a-b0cf-fdf0135969d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:42.870053 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285bea10-6129-490a-b0cf-fdf0135969d6 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:42.874654 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 644/1291] 10.222.0.20 () {56 vars in 1116 bytes} [Wed Jul 27 18:55:42 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:55:42.880436 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279319bf-f81a-4754-afd5-2fe0c71f9562 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:42.976313 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279319bf-f81a-4754-afd5-2fe0c71f9562 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:43.007988 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2718ce-d9bb-4cd7-a250-8d56bf920c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:43.008581 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2718ce-d9bb-4cd7-a250-8d56bf920c6d None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:43.008858 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2718ce-d9bb-4cd7-a250-8d56bf920c6d None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:43.009126 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2718ce-d9bb-4cd7-a250-8d56bf920c6d None admin] PATH_INFO: `/v3/services` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:43.009787 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2718ce-d9bb-4cd7-a250-8d56bf920c6d None admin] RBAC: Adding query filter params (type=placement) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:55:43.010086 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2718ce-d9bb-4cd7-a250-8d56bf920c6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:43.011421 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2718ce-d9bb-4cd7-a250-8d56bf920c6d None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:43.016214 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 648/1292] 10.222.0.20 () {56 vars in 1116 bytes} [Wed Jul 27 18:55:42 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:55:45.006884 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd7085-0d78-4da2-a609-9c9d09796e00 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:45.007481 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd7085-0d78-4da2-a609-9c9d09796e00 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:45.007481 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd7085-0d78-4da2-a609-9c9d09796e00 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:45.008829 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 645/1293] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:55:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:55:45.013913 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa740b-1683-424d-8f17-5edf24f3f7bb None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:45.014355 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa740b-1683-424d-8f17-5edf24f3f7bb None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:45.014468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa740b-1683-424d-8f17-5edf24f3f7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:45.032549 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-30fa740b-1683-424d-8f17-5edf24f3f7bb None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:55:45.033726 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-30fa740b-1683-424d-8f17-5edf24f3f7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:45.062297 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:45.098569 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 649/1294] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:55:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:55:45.120789 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd7085-0d78-4da2-a609-9c9d09796e00 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:45.152426 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:45.221320 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd7085-0d78-4da2-a609-9c9d09796e00 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:45.257838 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f27bb32-20a3-4f82-86aa-739a4e85dfe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:45.258346 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27bb32-20a3-4f82-86aa-739a4e85dfe5 None admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:45.258623 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27bb32-20a3-4f82-86aa-739a4e85dfe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:45.258922 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27bb32-20a3-4f82-86aa-739a4e85dfe5 None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:45.259658 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f27bb32-20a3-4f82-86aa-739a4e85dfe5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:45.261212 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f27bb32-20a3-4f82-86aa-739a4e85dfe5 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:45.291720 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 646/1295] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Jul 27 18:55:45 2022] POST /identity/v3/services => generated 246 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:55:47.306024 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95437f-d77a-4316-a556-e9a279296262 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:47.306580 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95437f-d77a-4316-a556-e9a279296262 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:47.306580 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95437f-d77a-4316-a556-e9a279296262 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:47.307957 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 650/1296] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:55:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:55:47.313139 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9dfdb-b27f-438a-81ae-39a98521c0a0 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:47.313607 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9dfdb-b27f-438a-81ae-39a98521c0a0 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:47.313709 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9dfdb-b27f-438a-81ae-39a98521c0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:47.331000 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-7eb9dfdb-b27f-438a-81ae-39a98521c0a0 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:55:47.332185 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-7eb9dfdb-b27f-438a-81ae-39a98521c0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:47.401329 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 647/1297] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:55:47 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:55:47.424102 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a95437f-d77a-4316-a556-e9a279296262 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:47.519752 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a95437f-d77a-4316-a556-e9a279296262 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:47.552477 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c296c1-dfcd-4e3b-abb4-5dceb6525ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:47.553094 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c296c1-dfcd-4e3b-abb4-5dceb6525ce8 None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:47.553371 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c296c1-dfcd-4e3b-abb4-5dceb6525ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:47.553641 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c296c1-dfcd-4e3b-abb4-5dceb6525ce8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:47.554252 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c296c1-dfcd-4e3b-abb4-5dceb6525ce8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:47.555590 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c296c1-dfcd-4e3b-abb4-5dceb6525ce8 None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:47.564190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-81c296c1-dfcd-4e3b-abb4-5dceb6525ce8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 18:55:47.564190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:55:47.564190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:55:47.564190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:55:47.564190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:55:47.564190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:55:47.564190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:55:47.564190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:55:47.564190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 18:55:47.564190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:55:47.564190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:55:47.564190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:55:47.564190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:55:47.564190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:55:47.564190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:55:47.564190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:55:47.564190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:55:47.565455 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:55:47.565455 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:55:47.565455 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:55:47.565455 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:55:47.565455 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:55:47.565455 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:55:47.565455 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:55:47.565455 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:55:47.565455 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:55:47.565455 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:55:47.565455 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:55:47.565455 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:55:47.565455 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:55:47.565455 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:55:47.565455 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:55:47.565455 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:55:47.566566 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:55:47.566566 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:55:47.566566 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:55:47.566566 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:55:47.566566 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:55:47.566566 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:55:47.566566 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:55:47.566566 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:55:47.566566 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:55:47.566566 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:55:47.566566 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:55:47.566566 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:55:47.566566 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 18:55:47.566566 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:55:47.566566 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 651/1298] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Jul 27 18:55:47 2022] GET /identity/v3/services/placement => generated 90 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:55:47.571244 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb9dfdb-b27f-438a-81ae-39a98521c0a0 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:47.589348 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:47.668397 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb9dfdb-b27f-438a-81ae-39a98521c0a0 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:47.701222 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97694ab6-696a-4654-8445-67e525317abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:47.701825 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97694ab6-696a-4654-8445-67e525317abd None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:47.702108 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97694ab6-696a-4654-8445-67e525317abd None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:47.702378 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97694ab6-696a-4654-8445-67e525317abd None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:47.703049 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97694ab6-696a-4654-8445-67e525317abd None admin] RBAC: Adding query filter params (name=placement) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:55:47.703352 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97694ab6-696a-4654-8445-67e525317abd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:47.704749 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97694ab6-696a-4654-8445-67e525317abd None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:47.709702 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 648/1299] 10.222.0.20 () {56 vars in 1116 bytes} [Wed Jul 27 18:55:47 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:55:47.715777 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c296c1-dfcd-4e3b-abb4-5dceb6525ce8 None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:47.747496 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:47.813384 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c296c1-dfcd-4e3b-abb4-5dceb6525ce8 None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:47.845265 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2a8119-8aa4-464e-9fc5-b288f24f842e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:47.845803 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a8119-8aa4-464e-9fc5-b288f24f842e None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:47.846083 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a8119-8aa4-464e-9fc5-b288f24f842e None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:47.846355 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a8119-8aa4-464e-9fc5-b288f24f842e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:47.847090 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2a8119-8aa4-464e-9fc5-b288f24f842e None admin] RBAC: Adding query filter params (interface=public, service_id=5ce138af5b1246a2a9ae2af9f41dca16, region_id=RegionOne) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:55:47.847396 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2a8119-8aa4-464e-9fc5-b288f24f842e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:47.848768 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2a8119-8aa4-464e-9fc5-b288f24f842e None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:47.853606 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 652/1300] 10.222.0.20 () {56 vars in 1251 bytes} [Wed Jul 27 18:55:47 2022] GET /identity/v3/endpoints?service_id=5ce138af5b1246a2a9ae2af9f41dca16&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:55:47.860059 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97694ab6-696a-4654-8445-67e525317abd None admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:47.938783 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:47.956652 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97694ab6-696a-4654-8445-67e525317abd None admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:47.990206 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130ea506-2e18-4c3a-aea9-1a3e43aa96f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:47.990803 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ea506-2e18-4c3a-aea9-1a3e43aa96f7 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:47.991085 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ea506-2e18-4c3a-aea9-1a3e43aa96f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:47.991359 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ea506-2e18-4c3a-aea9-1a3e43aa96f7 None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:47.992030 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130ea506-2e18-4c3a-aea9-1a3e43aa96f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:47.993375 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130ea506-2e18-4c3a-aea9-1a3e43aa96f7 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:48.000067 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 649/1301] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Jul 27 18:55:47 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:55:50.010778 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704950a-6702-47ee-be96-71dd9b440611 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:50.011345 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704950a-6702-47ee-be96-71dd9b440611 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:50.011345 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704950a-6702-47ee-be96-71dd9b440611 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:50.013266 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 653/1302] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:55:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:55:50.018375 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff76d19-fa38-4a2b-9fd8-7f574f899480 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:50.018822 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff76d19-fa38-4a2b-9fd8-7f574f899480 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:50.018918 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff76d19-fa38-4a2b-9fd8-7f574f899480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:50.037155 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-aff76d19-fa38-4a2b-9fd8-7f574f899480 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:55:50.038353 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-aff76d19-fa38-4a2b-9fd8-7f574f899480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:55:50.101002 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 650/1303] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:55:50 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:55:50.123592 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6704950a-6702-47ee-be96-71dd9b440611 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:50.215630 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:50.222655 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6704950a-6702-47ee-be96-71dd9b440611 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:50.261270 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ec9a22-ff5b-4b07-8a19-4cb2807ef6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:50.261847 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec9a22-ff5b-4b07-8a19-4cb2807ef6ca None admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:50.262152 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec9a22-ff5b-4b07-8a19-4cb2807ef6ca None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:50.262409 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec9a22-ff5b-4b07-8a19-4cb2807ef6ca None admin] PATH_INFO: `/v3/services/placement` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:50.263036 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ec9a22-ff5b-4b07-8a19-4cb2807ef6ca None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:50.264490 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ec9a22-ff5b-4b07-8a19-4cb2807ef6ca None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:50.274050 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application [None req-06ec9a22-ff5b-4b07-8a19-4cb2807ef6ca None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 18:55:50.274050 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:55:50.274050 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:55:50.274050 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:55:50.274050 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:55:50.274050 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:55:50.274050 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:55:50.274050 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:55:50.274050 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 18:55:50.274050 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:55:50.274050 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:55:50.274050 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:55:50.274050 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:55:50.274050 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:55:50.274050 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:55:50.274050 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:55:50.274050 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:55:50.275109 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:55:50.275109 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:55:50.275109 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:55:50.275109 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:55:50.275109 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:55:50.275109 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:55:50.275109 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:55:50.275109 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:55:50.275109 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:55:50.275109 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:55:50.275109 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:55:50.275109 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:55:50.275109 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:55:50.275109 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:55:50.275109 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:55:50.275109 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:55:50.276351 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:55:50.276351 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application with Lock( Jul 27 18:55:50.276351 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:55:50.276351 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:55:50.276351 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:55:50.276351 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:55:50.276351 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:55:50.276351 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:55:50.276351 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:55:50.276351 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:55:50.276351 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:55:50.276351 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:55:50.276351 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 18:55:50.276351 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: ERROR keystone.server.flask.application Jul 27 18:55:50.276351 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 654/1304] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Jul 27 18:55:50 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:55:50.281843 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff76d19-fa38-4a2b-9fd8-7f574f899480 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:50.360472 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:50.383581 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff76d19-fa38-4a2b-9fd8-7f574f899480 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:50.416233 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98165e-5c0c-40e3-9a48-782d805b2ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:50.416838 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98165e-5c0c-40e3-9a48-782d805b2ab1 None admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:50.417123 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98165e-5c0c-40e3-9a48-782d805b2ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:50.417397 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98165e-5c0c-40e3-9a48-782d805b2ab1 None admin] PATH_INFO: `/v3/services` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:50.418580 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b98165e-5c0c-40e3-9a48-782d805b2ab1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:55:50.418884 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b98165e-5c0c-40e3-9a48-782d805b2ab1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:50.420265 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b98165e-5c0c-40e3-9a48-782d805b2ab1 None admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:50.425240 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 651/1305] 10.222.0.20 () {56 vars in 1116 bytes} [Wed Jul 27 18:55:50 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:55:50.431132 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ec9a22-ff5b-4b07-8a19-4cb2807ef6ca None admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:50.529093 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ec9a22-ff5b-4b07-8a19-4cb2807ef6ca None admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:50.562608 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b29bfce-91f8-4d79-9312-e655cce3b02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:50.563213 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29bfce-91f8-4d79-9312-e655cce3b02a None admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:50.563495 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29bfce-91f8-4d79-9312-e655cce3b02a None admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:50.563797 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29bfce-91f8-4d79-9312-e655cce3b02a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:50.564492 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b29bfce-91f8-4d79-9312-e655cce3b02a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:50.565855 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b29bfce-91f8-4d79-9312-e655cce3b02a None admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:50.584601 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 655/1306] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Jul 27 18:55:50 2022] POST /identity/v3/endpoints => generated 331 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:56:00.422670 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=30 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:56:00.580293 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:56:53.123485 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb98af2-2f10-43e9-9b48-ed0e6e4f786c None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:56:53.123976 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb98af2-2f10-43e9-9b48-ed0e6e4f786c None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:56:53.124055 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb98af2-2f10-43e9-9b48-ed0e6e4f786c None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:56:53.125409 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 652/1307] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:56:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:56:53.130449 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fb47fd-a9f6-4774-ac59-7339b53c7a03 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:56:53.130845 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fb47fd-a9f6-4774-ac59-7339b53c7a03 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:56:53.131010 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fb47fd-a9f6-4774-ac59-7339b53c7a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:56:53.295980 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-93fb47fd-a9f6-4774-ac59-7339b53c7a03 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:56:53.297946 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-93fb47fd-a9f6-4774-ac59-7339b53c7a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:56:53.450022 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 656/1308] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:56:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:56:53.499433 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43706c0-a881-4a52-b14f-45afe5cc5014 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:56:53.499756 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43706c0-a881-4a52-b14f-45afe5cc5014 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:56:53.500248 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43706c0-a881-4a52-b14f-45afe5cc5014 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:56:53.501728 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 653/1309] 10.222.0.20 () {54 vars in 965 bytes} [Wed Jul 27 18:56:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:56:53.507778 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcfd5b1-c0a3-4b86-8ca8-04fe56d2afa5 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:56:53.508077 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcfd5b1-c0a3-4b86-8ca8-04fe56d2afa5 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:56:53.508356 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcfd5b1-c0a3-4b86-8ca8-04fe56d2afa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:56:53.598987 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-5dcfd5b1-c0a3-4b86-8ca8-04fe56d2afa5 None None] MFA Rules not processed for user `703f0431d017405d942539de93a565b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:56:53.600357 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-5dcfd5b1-c0a3-4b86-8ca8-04fe56d2afa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:56:53.623206 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:56:53.683256 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 657/1310] 10.222.0.20 () {58 vars in 1062 bytes} [Wed Jul 27 18:56:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:56:53.692090 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43706c0-a881-4a52-b14f-45afe5cc5014 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:56:53.693822 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-d43706c0-a881-4a52-b14f-45afe5cc5014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:56:53.807494 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43706c0-a881-4a52-b14f-45afe5cc5014 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:56:53.885200 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5bce79-dbf4-46ec-86b2-889aa9b5f7f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703f0431d017405d942539de93a565b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:56:53.885718 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5bce79-dbf4-46ec-86b2-889aa9b5f7f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:56:53.885995 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5bce79-dbf4-46ec-86b2-889aa9b5f7f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:56:53.886267 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5bce79-dbf4-46ec-86b2-889aa9b5f7f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:56:53.888036 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-ed5bce79-dbf4-46ec-86b2-889aa9b5f7f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:56:53.944968 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:56:54.007262 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5bce79-dbf4-46ec-86b2-889aa9b5f7f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:56:54.009402 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5bce79-dbf4-46ec-86b2-889aa9b5f7f4 service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:56:54.044098 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 654/1311] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 18:56:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:56:56.387455 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a620f2d-60e7-4459-a407-3ef4f2904ce2 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:56:56.388061 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a620f2d-60e7-4459-a407-3ef4f2904ce2 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:56:56.388061 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a620f2d-60e7-4459-a407-3ef4f2904ce2 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:56:56.389445 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 658/1312] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:56:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:56:56.394680 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b2056-cec4-4bdd-8102-e786ce6686ff None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:56:56.395068 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b2056-cec4-4bdd-8102-e786ce6686ff None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:56:56.395360 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b2056-cec4-4bdd-8102-e786ce6686ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:56:56.464906 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-020b2056-cec4-4bdd-8102-e786ce6686ff None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:56:56.466103 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-020b2056-cec4-4bdd-8102-e786ce6686ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:56:56.562460 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 655/1313] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:56:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:56:56.606126 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a620f2d-60e7-4459-a407-3ef4f2904ce2 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:56:56.607755 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-2a620f2d-60e7-4459-a407-3ef4f2904ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:56:56.718283 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a620f2d-60e7-4459-a407-3ef4f2904ce2 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:56:56.795392 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:56:56.797825 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e15182-2408-4fed-a597-262ff2daa003 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703f0431d017405d942539de93a565b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:56:56.798450 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e15182-2408-4fed-a597-262ff2daa003 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:56:56.798979 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e15182-2408-4fed-a597-262ff2daa003 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:56:56.799403 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e15182-2408-4fed-a597-262ff2daa003 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:56:56.801291 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-40e15182-2408-4fed-a597-262ff2daa003 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:56:56.910353 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e15182-2408-4fed-a597-262ff2daa003 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:56:56.911823 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e15182-2408-4fed-a597-262ff2daa003 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:56:56.930463 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 659/1314] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 18:56:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:56:59.225779 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34a04e-a8e6-4311-b894-b633caa4baa3 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:56:59.226313 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34a04e-a8e6-4311-b894-b633caa4baa3 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:56:59.227165 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34a04e-a8e6-4311-b894-b633caa4baa3 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:56:59.228661 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 656/1315] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:56:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:56:59.233952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd33b5b2-1097-4fcd-b345-24da12d70eac None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:56:59.234401 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd33b5b2-1097-4fcd-b345-24da12d70eac None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:56:59.234507 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd33b5b2-1097-4fcd-b345-24da12d70eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:56:59.299180 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-dd33b5b2-1097-4fcd-b345-24da12d70eac None None] MFA Rules not processed for user `78ed1d1d6c8a4c3ea357e2812cecb67f`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:56:59.300319 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-dd33b5b2-1097-4fcd-b345-24da12d70eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:56:59.352621 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:56:59.397835 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 660/1316] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:56:59 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:56:59.438085 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34a04e-a8e6-4311-b894-b633caa4baa3 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:56:59.439828 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-de34a04e-a8e6-4311-b894-b633caa4baa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:56:59.449777 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:56:59.542886 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34a04e-a8e6-4311-b894-b633caa4baa3 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:56:59.614818 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c166d94b-fe82-4429-beb5-a9841f23ecc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703f0431d017405d942539de93a565b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:56:59.615354 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166d94b-fe82-4429-beb5-a9841f23ecc2 service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:56:59.615636 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166d94b-fe82-4429-beb5-a9841f23ecc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:56:59.615938 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166d94b-fe82-4429-beb5-a9841f23ecc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:56:59.617591 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-c166d94b-fe82-4429-beb5-a9841f23ecc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:56:59.677527 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:56:59.723255 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c166d94b-fe82-4429-beb5-a9841f23ecc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:56:59.724709 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c166d94b-fe82-4429-beb5-a9841f23ecc2 service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:56:59.744803 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 657/1317] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 18:56:59 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:57:02.253875 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29624544-87f5-4f26-b59c-c0449c87bfe7 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:57:02.254419 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29624544-87f5-4f26-b59c-c0449c87bfe7 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:57:02.254419 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29624544-87f5-4f26-b59c-c0449c87bfe7 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:57:02.255800 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 661/1318] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:57:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:57:02.260765 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4a800-73bd-4aca-85d2-e5fc59d20f60 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:57:02.261176 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4a800-73bd-4aca-85d2-e5fc59d20f60 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:57:02.261314 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4a800-73bd-4aca-85d2-e5fc59d20f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:57:02.324644 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-3fc4a800-73bd-4aca-85d2-e5fc59d20f60 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:57:02.325834 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-3fc4a800-73bd-4aca-85d2-e5fc59d20f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:57:02.419068 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 658/1319] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:57:02 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:57:02.457177 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29624544-87f5-4f26-b59c-c0449c87bfe7 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:57:02.458694 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-29624544-87f5-4f26-b59c-c0449c87bfe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:57:02.563957 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29624544-87f5-4f26-b59c-c0449c87bfe7 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:57:02.636379 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76d384-9e8a-4555-9713-12641552e6c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703f0431d017405d942539de93a565b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:57:02.636990 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76d384-9e8a-4555-9713-12641552e6c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:57:02.637270 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76d384-9e8a-4555-9713-12641552e6c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:57:02.637545 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76d384-9e8a-4555-9713-12641552e6c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:57:02.639171 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-fd76d384-9e8a-4555-9713-12641552e6c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:57:02.646459 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:57:02.744716 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd76d384-9e8a-4555-9713-12641552e6c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:57:02.746156 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd76d384-9e8a-4555-9713-12641552e6c5 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:57:02.763318 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 662/1320] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 18:57:02 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:57:05.397573 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c710680-6ff5-46f2-932d-5c34e36bd1cd None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:57:05.398102 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c710680-6ff5-46f2-932d-5c34e36bd1cd None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:57:05.398102 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c710680-6ff5-46f2-932d-5c34e36bd1cd None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:57:05.399396 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 659/1321] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:57:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:57:05.404516 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884042d7-09ad-4d73-9cc1-3c6695822ec3 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:57:05.404907 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884042d7-09ad-4d73-9cc1-3c6695822ec3 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:57:05.405057 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884042d7-09ad-4d73-9cc1-3c6695822ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:57:05.472799 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-884042d7-09ad-4d73-9cc1-3c6695822ec3 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:57:05.473984 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-884042d7-09ad-4d73-9cc1-3c6695822ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:57:05.533991 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:57:05.577721 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 663/1322] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:57:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:57:05.630598 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b3eaa0-826f-45a4-916b-4ec597ca6476 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:57:05.630889 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b3eaa0-826f-45a4-916b-4ec597ca6476 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:57:05.631166 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b3eaa0-826f-45a4-916b-4ec597ca6476 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:57:05.632607 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 660/1323] 10.222.0.20 () {54 vars in 965 bytes} [Wed Jul 27 18:57:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:57:05.639042 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6ee8f-993d-4c9f-8ea7-a3050d97a521 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:57:05.639329 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6ee8f-993d-4c9f-8ea7-a3050d97a521 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:57:05.639602 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6ee8f-993d-4c9f-8ea7-a3050d97a521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:57:05.721440 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-e9e6ee8f-993d-4c9f-8ea7-a3050d97a521 None None] MFA Rules not processed for user `703f0431d017405d942539de93a565b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:57:05.722646 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-e9e6ee8f-993d-4c9f-8ea7-a3050d97a521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:57:05.799065 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 664/1324] 10.222.0.20 () {58 vars in 1062 bytes} [Wed Jul 27 18:57:05 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:57:05.808049 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b3eaa0-826f-45a4-916b-4ec597ca6476 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:57:05.809654 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-84b3eaa0-826f-45a4-916b-4ec597ca6476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:57:05.829889 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:57:05.912350 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b3eaa0-826f-45a4-916b-4ec597ca6476 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:57:05.984692 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311c2c10-3a2e-456f-8f03-8dcff5cc5678 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703f0431d017405d942539de93a565b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:57:05.985205 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c2c10-3a2e-456f-8f03-8dcff5cc5678 service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:57:05.985486 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c2c10-3a2e-456f-8f03-8dcff5cc5678 service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:57:05.985759 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c2c10-3a2e-456f-8f03-8dcff5cc5678 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:57:05.987394 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-311c2c10-3a2e-456f-8f03-8dcff5cc5678 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:57:06.057744 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:57:06.095449 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311c2c10-3a2e-456f-8f03-8dcff5cc5678 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:57:06.096914 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311c2c10-3a2e-456f-8f03-8dcff5cc5678 service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:57:06.115177 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 661/1325] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 18:57:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:57:08.388631 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852b938-524e-4013-90ef-ed193343fe91 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:57:08.389212 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852b938-524e-4013-90ef-ed193343fe91 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:57:08.389212 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852b938-524e-4013-90ef-ed193343fe91 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:57:08.390543 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 665/1326] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:57:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:57:08.395834 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366c98b-0159-4dd3-a49d-f8fcfc063e80 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:57:08.396240 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366c98b-0159-4dd3-a49d-f8fcfc063e80 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:57:08.396392 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366c98b-0159-4dd3-a49d-f8fcfc063e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:57:08.465704 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-4366c98b-0159-4dd3-a49d-f8fcfc063e80 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:57:08.466961 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-4366c98b-0159-4dd3-a49d-f8fcfc063e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:57:08.572365 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 662/1327] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:57:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:57:08.608396 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9852b938-524e-4013-90ef-ed193343fe91 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:57:08.609924 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-9852b938-524e-4013-90ef-ed193343fe91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:57:08.679500 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:57:08.725515 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9852b938-524e-4013-90ef-ed193343fe91 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:57:08.800498 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31330f-a5c7-4e27-810d-0615eba8616b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703f0431d017405d942539de93a565b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:57:08.801118 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31330f-a5c7-4e27-810d-0615eba8616b service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:57:08.801519 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31330f-a5c7-4e27-810d-0615eba8616b service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:57:08.801791 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31330f-a5c7-4e27-810d-0615eba8616b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:57:08.803413 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-3c31330f-a5c7-4e27-810d-0615eba8616b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:57:08.909559 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:57:08.911972 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c31330f-a5c7-4e27-810d-0615eba8616b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:57:08.913414 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c31330f-a5c7-4e27-810d-0615eba8616b service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:57:08.932793 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 666/1328] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 18:57:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:57:10.979851 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a96c32-74f8-4191-930d-5e17e71c33ee None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:57:10.980420 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a96c32-74f8-4191-930d-5e17e71c33ee None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:57:10.980420 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a96c32-74f8-4191-930d-5e17e71c33ee None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:57:10.981743 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 663/1329] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:57:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:57:10.986814 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c10fa6-e0b7-48c3-bb60-75bb7e794984 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:57:10.987228 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c10fa6-e0b7-48c3-bb60-75bb7e794984 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:57:10.987347 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c10fa6-e0b7-48c3-bb60-75bb7e794984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:57:11.052253 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-a0c10fa6-e0b7-48c3-bb60-75bb7e794984 None None] MFA Rules not processed for user `78ed1d1d6c8a4c3ea357e2812cecb67f`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:57:11.053435 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a0c10fa6-e0b7-48c3-bb60-75bb7e794984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:57:11.153378 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 667/1330] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:57:10 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:57:11.190394 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a96c32-74f8-4191-930d-5e17e71c33ee None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:57:11.191966 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-d4a96c32-74f8-4191-930d-5e17e71c33ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:57:11.222164 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:57:11.310618 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a96c32-74f8-4191-930d-5e17e71c33ee None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:57:11.386387 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d4df0-e1ff-4f7d-a600-6ab01f501f63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703f0431d017405d942539de93a565b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:57:11.387011 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d4df0-e1ff-4f7d-a600-6ab01f501f63 service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:57:11.387288 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d4df0-e1ff-4f7d-a600-6ab01f501f63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:57:11.387559 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d4df0-e1ff-4f7d-a600-6ab01f501f63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:57:11.389236 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-cf2d4df0-e1ff-4f7d-a600-6ab01f501f63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:57:11.469142 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:57:11.501517 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2d4df0-e1ff-4f7d-a600-6ab01f501f63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:57:11.502950 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2d4df0-e1ff-4f7d-a600-6ab01f501f63 service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:57:11.521162 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 664/1331] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 18:57:11 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:57:13.953029 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71644b-8d41-4170-8481-ab0a64e90108 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:57:13.953564 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71644b-8d41-4170-8481-ab0a64e90108 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:57:13.953660 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71644b-8d41-4170-8481-ab0a64e90108 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:57:13.954994 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 668/1332] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:57:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:57:13.960305 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e0d1e-7796-4cbe-a47f-034b4188a347 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:57:13.961562 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e0d1e-7796-4cbe-a47f-034b4188a347 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:57:13.962015 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e0d1e-7796-4cbe-a47f-034b4188a347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:57:14.027502 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-c70e0d1e-7796-4cbe-a47f-034b4188a347 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:57:14.028730 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-c70e0d1e-7796-4cbe-a47f-034b4188a347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:57:14.123134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 665/1333] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:57:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:57:14.159759 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff71644b-8d41-4170-8481-ab0a64e90108 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:57:14.161468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-ff71644b-8d41-4170-8481-ab0a64e90108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:57:14.230485 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:57:14.265840 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff71644b-8d41-4170-8481-ab0a64e90108 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:57:14.337677 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3af48f-5f81-4983-9e41-54e398b6c228 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703f0431d017405d942539de93a565b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:57:14.338279 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3af48f-5f81-4983-9e41-54e398b6c228 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:57:14.338559 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3af48f-5f81-4983-9e41-54e398b6c228 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:57:14.338834 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3af48f-5f81-4983-9e41-54e398b6c228 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:57:14.340481 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-fd3af48f-5f81-4983-9e41-54e398b6c228 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:57:14.450786 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3af48f-5f81-4983-9e41-54e398b6c228 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:57:14.452245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3af48f-5f81-4983-9e41-54e398b6c228 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:57:14.462091 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:57:14.470670 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 669/1334] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 18:57:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:57:16.528212 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf4b40-233e-4764-b0bc-5baf383f1d10 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:57:16.528865 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf4b40-233e-4764-b0bc-5baf383f1d10 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:57:16.528865 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf4b40-233e-4764-b0bc-5baf383f1d10 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:57:16.530127 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 666/1335] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:57:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:57:16.535364 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f652c58-556d-4e0b-8705-842eb3703bbc None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:57:16.535810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f652c58-556d-4e0b-8705-842eb3703bbc None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:57:16.535942 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f652c58-556d-4e0b-8705-842eb3703bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:57:16.599900 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-1f652c58-556d-4e0b-8705-842eb3703bbc None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:57:16.601065 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-1f652c58-556d-4e0b-8705-842eb3703bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:57:16.694373 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 670/1336] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:57:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:57:16.734436 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf4b40-233e-4764-b0bc-5baf383f1d10 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:57:16.736013 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-4dbf4b40-233e-4764-b0bc-5baf383f1d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:57:16.775071 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:57:16.835948 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf4b40-233e-4764-b0bc-5baf383f1d10 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:57:16.907349 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c003fe-3dfa-4ccf-b079-2bad0369343f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703f0431d017405d942539de93a565b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:57:16.907981 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c003fe-3dfa-4ccf-b079-2bad0369343f service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:57:16.908256 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c003fe-3dfa-4ccf-b079-2bad0369343f service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:57:16.908524 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c003fe-3dfa-4ccf-b079-2bad0369343f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:57:16.910180 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-e9c003fe-3dfa-4ccf-b079-2bad0369343f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:57:16.989206 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:57:17.015103 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c003fe-3dfa-4ccf-b079-2bad0369343f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:57:17.016559 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c003fe-3dfa-4ccf-b079-2bad0369343f service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:57:17.034496 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 667/1337] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 18:57:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:57:19.394871 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e543087-8ec2-4bb8-bc7d-873dffa7ea5d None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:57:19.395397 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e543087-8ec2-4bb8-bc7d-873dffa7ea5d None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:57:19.395397 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e543087-8ec2-4bb8-bc7d-873dffa7ea5d None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:57:19.396733 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 671/1338] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:57:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:57:19.402498 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe6e02-56ff-463b-a15d-c7b154ba738e None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:57:19.402916 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe6e02-56ff-463b-a15d-c7b154ba738e None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:57:19.403022 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe6e02-56ff-463b-a15d-c7b154ba738e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:57:19.468128 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-24fe6e02-56ff-463b-a15d-c7b154ba738e None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:57:19.469312 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-24fe6e02-56ff-463b-a15d-c7b154ba738e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:57:19.564451 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 668/1339] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:57:19 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:57:19.600400 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e543087-8ec2-4bb8-bc7d-873dffa7ea5d None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:57:19.602435 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-6e543087-8ec2-4bb8-bc7d-873dffa7ea5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:57:19.678806 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:57:19.706156 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e543087-8ec2-4bb8-bc7d-873dffa7ea5d None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:57:19.777129 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa957132-56f3-4d3a-910d-4615084926ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703f0431d017405d942539de93a565b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:57:19.777730 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa957132-56f3-4d3a-910d-4615084926ab service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:57:19.778005 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa957132-56f3-4d3a-910d-4615084926ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:57:19.778270 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa957132-56f3-4d3a-910d-4615084926ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:57:19.779884 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-fa957132-56f3-4d3a-910d-4615084926ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:57:19.883971 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa957132-56f3-4d3a-910d-4615084926ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:57:19.885370 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa957132-56f3-4d3a-910d-4615084926ab service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:57:19.903134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 672/1340] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 18:57:19 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:57:23.940926 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ea2a7-120b-45d7-9ac8-bc6e0baf0aee None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:57:23.941453 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ea2a7-120b-45d7-9ac8-bc6e0baf0aee None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:57:23.941453 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ea2a7-120b-45d7-9ac8-bc6e0baf0aee None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:57:23.942824 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 669/1341] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:57:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:57:23.948125 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82fee90-632e-4790-910d-70da44f1e18f None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:57:23.948566 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82fee90-632e-4790-910d-70da44f1e18f None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:57:23.948669 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82fee90-632e-4790-910d-70da44f1e18f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:57:23.954201 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:57:24.015777 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-e82fee90-632e-4790-910d-70da44f1e18f None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:57:24.016974 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-e82fee90-632e-4790-910d-70da44f1e18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:57:24.119059 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 673/1342] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:57:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:57:24.157908 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ea2a7-120b-45d7-9ac8-bc6e0baf0aee None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:57:24.159580 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-022ea2a7-120b-45d7-9ac8-bc6e0baf0aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:57:24.218321 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:57:24.291206 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ea2a7-120b-45d7-9ac8-bc6e0baf0aee None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:57:24.375108 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178dc4b-8e8f-46e7-9f9c-001a744dbd27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703f0431d017405d942539de93a565b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:57:24.375636 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178dc4b-8e8f-46e7-9f9c-001a744dbd27 service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:57:24.375942 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178dc4b-8e8f-46e7-9f9c-001a744dbd27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:57:24.376211 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178dc4b-8e8f-46e7-9f9c-001a744dbd27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:57:24.377833 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-b178dc4b-8e8f-46e7-9f9c-001a744dbd27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:57:24.470952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:57:24.488136 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b178dc4b-8e8f-46e7-9f9c-001a744dbd27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:57:24.489568 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b178dc4b-8e8f-46e7-9f9c-001a744dbd27 service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:57:24.508256 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 670/1343] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 18:57:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:57:27.169478 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6904071-7025-44c4-b0df-5f58b705815f None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:57:27.170017 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6904071-7025-44c4-b0df-5f58b705815f None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:57:27.170017 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6904071-7025-44c4-b0df-5f58b705815f None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:57:27.171359 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 674/1344] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:57:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:57:27.176514 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3ab24-cd6b-4435-a505-3ba595f63684 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:57:27.176941 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3ab24-cd6b-4435-a505-3ba595f63684 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:57:27.177068 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3ab24-cd6b-4435-a505-3ba595f63684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:57:27.241268 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-ffd3ab24-cd6b-4435-a505-3ba595f63684 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:57:27.242977 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-ffd3ab24-cd6b-4435-a505-3ba595f63684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:57:27.342269 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 671/1345] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:57:27 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:57:27.379933 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6904071-7025-44c4-b0df-5f58b705815f None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:57:27.381597 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-d6904071-7025-44c4-b0df-5f58b705815f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:57:27.469119 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:57:27.486439 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6904071-7025-44c4-b0df-5f58b705815f None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:57:27.565436 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ceb8de-54cd-4a53-810b-95f1789456cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703f0431d017405d942539de93a565b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:57:27.566044 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ceb8de-54cd-4a53-810b-95f1789456cb service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:57:27.566332 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ceb8de-54cd-4a53-810b-95f1789456cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:57:27.566606 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ceb8de-54cd-4a53-810b-95f1789456cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:57:27.568248 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-40ceb8de-54cd-4a53-810b-95f1789456cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:57:27.693580 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ceb8de-54cd-4a53-810b-95f1789456cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:57:27.695988 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ceb8de-54cd-4a53-810b-95f1789456cb service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:57:27.714474 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 675/1346] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 18:57:27 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:57:31.645030 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b10bd-f71d-4b9d-8075-42298e5dd7c4 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:57:31.645514 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b10bd-f71d-4b9d-8075-42298e5dd7c4 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:57:31.645616 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b10bd-f71d-4b9d-8075-42298e5dd7c4 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:57:31.646920 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 672/1347] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:57:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:57:31.653058 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffda4f5-8342-400d-a072-f806c1cb19dd None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:57:31.653511 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffda4f5-8342-400d-a072-f806c1cb19dd None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:57:31.653605 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffda4f5-8342-400d-a072-f806c1cb19dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:57:31.669527 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:57:31.741037 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-8ffda4f5-8342-400d-a072-f806c1cb19dd None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:57:31.742249 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-8ffda4f5-8342-400d-a072-f806c1cb19dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:57:31.851212 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 676/1348] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:57:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:57:31.890501 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b10bd-f71d-4b9d-8075-42298e5dd7c4 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:57:31.892186 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-eb5b10bd-f71d-4b9d-8075-42298e5dd7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:57:31.951919 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:57:31.999510 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b10bd-f71d-4b9d-8075-42298e5dd7c4 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:57:32.074294 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ae69e-6dc2-4b2c-947c-647fd89c6c93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703f0431d017405d942539de93a565b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:57:32.074914 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ae69e-6dc2-4b2c-947c-647fd89c6c93 service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:57:32.075192 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ae69e-6dc2-4b2c-947c-647fd89c6c93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:57:32.075463 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ae69e-6dc2-4b2c-947c-647fd89c6c93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:57:32.077162 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-f15ae69e-6dc2-4b2c-947c-647fd89c6c93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:57:32.186789 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:57:32.191143 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15ae69e-6dc2-4b2c-947c-647fd89c6c93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:57:32.192575 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15ae69e-6dc2-4b2c-947c-647fd89c6c93 service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:57:32.211509 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 673/1349] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 18:57:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:57:37.144175 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83acb13d-0f88-461b-bc77-7612daae9ce2 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:57:37.144175 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83acb13d-0f88-461b-bc77-7612daae9ce2 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:57:37.144175 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83acb13d-0f88-461b-bc77-7612daae9ce2 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:57:37.144175 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 677/1350] 10.222.0.20 () {54 vars in 921 bytes} [Wed Jul 27 18:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:57:37.147811 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf5db3-2cc9-4ee2-90a0-fbad00226c1e None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:57:37.147811 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf5db3-2cc9-4ee2-90a0-fbad00226c1e None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:57:37.147811 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf5db3-2cc9-4ee2-90a0-fbad00226c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:57:37.286194 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-3baf5db3-2cc9-4ee2-90a0-fbad00226c1e None None] MFA Rules not processed for user `3b0382b170fb49e785a57bbb329d4b37`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:57:37.287662 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-3baf5db3-2cc9-4ee2-90a0-fbad00226c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:57:37.403457 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 674/1351] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Jul 27 18:57:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:57:41.657521 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa62396-53c9-4edc-a0f8-72c8ebc8ed34 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:57:41.658039 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa62396-53c9-4edc-a0f8-72c8ebc8ed34 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:57:41.658152 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa62396-53c9-4edc-a0f8-72c8ebc8ed34 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:57:41.659581 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 678/1352] 10.222.0.20 () {54 vars in 921 bytes} [Wed Jul 27 18:57:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:57:41.664875 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2920b-00a2-4c81-94e3-4eeea6d259dd None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:57:41.665727 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2920b-00a2-4c81-94e3-4eeea6d259dd None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:57:41.666215 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2920b-00a2-4c81-94e3-4eeea6d259dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:57:41.728429 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:57:41.755565 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-6ad2920b-00a2-4c81-94e3-4eeea6d259dd None None] MFA Rules not processed for user `3b0382b170fb49e785a57bbb329d4b37`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:57:41.757197 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-6ad2920b-00a2-4c81-94e3-4eeea6d259dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:57:41.852129 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=59 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:57:41.876363 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 675/1353] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Jul 27 18:57:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:57:43.263020 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b26abc-6565-49ef-9342-37c19022dcad None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:57:43.263546 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b26abc-6565-49ef-9342-37c19022dcad None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:57:43.263546 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b26abc-6565-49ef-9342-37c19022dcad None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:57:43.264949 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 679/1354] 10.222.0.20 () {54 vars in 921 bytes} [Wed Jul 27 18:57:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:57:43.270203 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38512bf-501a-4394-8842-61b3b033401c None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:57:43.270732 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38512bf-501a-4394-8842-61b3b033401c None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:57:43.270732 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38512bf-501a-4394-8842-61b3b033401c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:57:43.349186 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-e38512bf-501a-4394-8842-61b3b033401c None None] MFA Rules not processed for user `3b0382b170fb49e785a57bbb329d4b37`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:57:43.350303 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-e38512bf-501a-4394-8842-61b3b033401c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:57:43.393148 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:57:43.457234 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 676/1355] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Jul 27 18:57:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:57:46.839059 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a60e41-5f09-4267-ad17-bfd731887a22 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:57:46.839627 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a60e41-5f09-4267-ad17-bfd731887a22 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:57:46.839627 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a60e41-5f09-4267-ad17-bfd731887a22 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:57:46.841144 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 680/1356] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:57:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:57:46.846559 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc27cb1-c16a-453a-90c6-123557266d83 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:57:46.847053 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc27cb1-c16a-453a-90c6-123557266d83 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:57:46.847136 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc27cb1-c16a-453a-90c6-123557266d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:57:46.933473 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-fcc27cb1-c16a-453a-90c6-123557266d83 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:57:46.934694 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-fcc27cb1-c16a-453a-90c6-123557266d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:57:47.034959 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 677/1357] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:57:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:57:47.090830 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de037f91-4155-4e6d-8451-7c514d03ef74 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:57:47.091670 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de037f91-4155-4e6d-8451-7c514d03ef74 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:57:47.092341 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de037f91-4155-4e6d-8451-7c514d03ef74 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:57:47.094736 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 681/1358] 10.222.0.20 () {54 vars in 962 bytes} [Wed Jul 27 18:57:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:57:47.104053 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548f1d1-e455-41c8-8db4-251907f778db None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:57:47.105452 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548f1d1-e455-41c8-8db4-251907f778db None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:57:47.106810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548f1d1-e455-41c8-8db4-251907f778db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:57:47.126083 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:57:47.190569 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-3548f1d1-e455-41c8-8db4-251907f778db None None] MFA Rules not processed for user `17fbef9db7734283aaad4962ee160171`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:57:47.191772 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-3548f1d1-e455-41c8-8db4-251907f778db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:57:47.311104 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 678/1359] 10.222.0.20 () {58 vars in 1059 bytes} [Wed Jul 27 18:57:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:57:47.319021 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de037f91-4155-4e6d-8451-7c514d03ef74 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:57:47.320677 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-de037f91-4155-4e6d-8451-7c514d03ef74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:57:47.479482 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de037f91-4155-4e6d-8451-7c514d03ef74 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:57:47.559605 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:57:47.603860 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55506a12-5e0f-4a97-9820-86b4e6aff0c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17fbef9db7734283aaad4962ee160171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:57:47.604628 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55506a12-5e0f-4a97-9820-86b4e6aff0c1 service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:57:47.605037 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55506a12-5e0f-4a97-9820-86b4e6aff0c1 service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:57:47.605413 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55506a12-5e0f-4a97-9820-86b4e6aff0c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:57:47.607414 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-55506a12-5e0f-4a97-9820-86b4e6aff0c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:57:47.703478 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55506a12-5e0f-4a97-9820-86b4e6aff0c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:57:47.705140 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55506a12-5e0f-4a97-9820-86b4e6aff0c1 service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:57:47.724418 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 682/1360] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 18:57:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:57:49.976468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc99cc-d0c2-49a9-b1ac-830b03111a48 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:57:49.977009 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc99cc-d0c2-49a9-b1ac-830b03111a48 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:57:49.977121 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc99cc-d0c2-49a9-b1ac-830b03111a48 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:57:49.978422 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 679/1361] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:57:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:57:49.984320 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574d22b-6df2-4249-8a84-090e8eb5873a None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:57:49.984792 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574d22b-6df2-4249-8a84-090e8eb5873a None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:57:49.984886 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574d22b-6df2-4249-8a84-090e8eb5873a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:57:50.057154 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-c574d22b-6df2-4249-8a84-090e8eb5873a None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:57:50.058470 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-c574d22b-6df2-4249-8a84-090e8eb5873a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:57:50.098376 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:57:50.173880 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 683/1362] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:57:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:57:50.209620 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc99cc-d0c2-49a9-b1ac-830b03111a48 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:57:50.211252 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-3cfc99cc-d0c2-49a9-b1ac-830b03111a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:57:50.294071 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:57:50.382679 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc99cc-d0c2-49a9-b1ac-830b03111a48 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:57:50.505845 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7972a5b3-4313-4df4-86c1-5a892cfaa465 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17fbef9db7734283aaad4962ee160171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:57:50.506662 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972a5b3-4313-4df4-86c1-5a892cfaa465 service nova] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:57:50.506875 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972a5b3-4313-4df4-86c1-5a892cfaa465 service nova] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:57:50.507146 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972a5b3-4313-4df4-86c1-5a892cfaa465 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:57:50.508866 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-7972a5b3-4313-4df4-86c1-5a892cfaa465 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:57:50.543668 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:57:50.613710 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7972a5b3-4313-4df4-86c1-5a892cfaa465 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:57:50.615323 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7972a5b3-4313-4df4-86c1-5a892cfaa465 service nova] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:57:50.647586 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 680/1363] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 18:57:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:57:52.985126 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b11768-0206-4996-a5b9-220f820442a7 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:57:52.986023 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b11768-0206-4996-a5b9-220f820442a7 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:57:52.986327 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b11768-0206-4996-a5b9-220f820442a7 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:57:52.988080 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 684/1364] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:57:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:57:52.993027 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12904d-e738-40ee-85ee-b15b90dff37a None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:57:52.993481 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12904d-e738-40ee-85ee-b15b90dff37a None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:57:52.993595 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12904d-e738-40ee-85ee-b15b90dff37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:57:53.068470 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-8b12904d-e738-40ee-85ee-b15b90dff37a None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:57:53.069676 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-8b12904d-e738-40ee-85ee-b15b90dff37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:57:53.193776 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:57:53.199720 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 681/1365] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:57:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:57:53.243325 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf29ac-78ac-4bea-9e7e-b2404a29d0b9 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:57:53.243537 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf29ac-78ac-4bea-9e7e-b2404a29d0b9 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:57:53.244187 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf29ac-78ac-4bea-9e7e-b2404a29d0b9 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:57:53.245616 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 685/1366] 10.222.0.20 () {54 vars in 962 bytes} [Wed Jul 27 18:57:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:57:53.252386 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10150765-96d8-47a5-89e8-7d3c4d741c53 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:57:53.252848 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10150765-96d8-47a5-89e8-7d3c4d741c53 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:57:53.253283 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10150765-96d8-47a5-89e8-7d3c4d741c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:57:53.332299 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-10150765-96d8-47a5-89e8-7d3c4d741c53 None None] MFA Rules not processed for user `17fbef9db7734283aaad4962ee160171`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:57:53.333485 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-10150765-96d8-47a5-89e8-7d3c4d741c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:57:53.462364 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 682/1367] 10.222.0.20 () {58 vars in 1059 bytes} [Wed Jul 27 18:57:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:57:53.471952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecf29ac-78ac-4bea-9e7e-b2404a29d0b9 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:57:53.473648 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-aecf29ac-78ac-4bea-9e7e-b2404a29d0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:57:53.644286 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecf29ac-78ac-4bea-9e7e-b2404a29d0b9 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:57:53.665479 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:57:53.784602 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35daf3cc-f74c-47e9-97d7-1395e1c93c35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17fbef9db7734283aaad4962ee160171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:57:53.785266 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35daf3cc-f74c-47e9-97d7-1395e1c93c35 service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:57:53.785644 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35daf3cc-f74c-47e9-97d7-1395e1c93c35 service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:57:53.786205 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35daf3cc-f74c-47e9-97d7-1395e1c93c35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:57:53.788087 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-35daf3cc-f74c-47e9-97d7-1395e1c93c35 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:57:53.884212 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35daf3cc-f74c-47e9-97d7-1395e1c93c35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:57:53.885966 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35daf3cc-f74c-47e9-97d7-1395e1c93c35 service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:57:53.904980 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 686/1368] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 18:57:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:57:54.945630 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48984f73-d3cf-4038-bdde-4bfad16bf571 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:57:54.946163 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48984f73-d3cf-4038-bdde-4bfad16bf571 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:57:54.946258 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48984f73-d3cf-4038-bdde-4bfad16bf571 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:57:54.947757 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 683/1369] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:57:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:57:54.952780 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f88d7a5-22c1-47f8-b8cb-c85d19993bd0 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:57:54.953222 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f88d7a5-22c1-47f8-b8cb-c85d19993bd0 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:57:54.953326 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f88d7a5-22c1-47f8-b8cb-c85d19993bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:57:54.987280 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:57:55.026893 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-8f88d7a5-22c1-47f8-b8cb-c85d19993bd0 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:57:55.028313 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-8f88d7a5-22c1-47f8-b8cb-c85d19993bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:57:55.148182 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 687/1370] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:57:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:57:55.483471 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e51291-05ad-4099-b465-4b9db6f2aeeb None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:57:55.484490 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e51291-05ad-4099-b465-4b9db6f2aeeb None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:57:55.484490 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e51291-05ad-4099-b465-4b9db6f2aeeb None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:57:55.485580 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 684/1371] 10.222.0.20 () {54 vars in 964 bytes} [Wed Jul 27 18:57:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:57:55.490256 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a75022-0fa3-4367-9881-3f5df23014aa None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:57:55.490550 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a75022-0fa3-4367-9881-3f5df23014aa None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:57:55.490830 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a75022-0fa3-4367-9881-3f5df23014aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:57:55.592797 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-41a75022-0fa3-4367-9881-3f5df23014aa None None] MFA Rules not processed for user `d5525865e12c41fe8da761cd25c14e2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:57:55.594156 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-41a75022-0fa3-4367-9881-3f5df23014aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:57:55.645171 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:57:55.678324 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 688/1372] 10.222.0.20 () {58 vars in 1061 bytes} [Wed Jul 27 18:57:55 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:57:55.686335 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e51291-05ad-4099-b465-4b9db6f2aeeb None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:57:55.688265 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-86e51291-05ad-4099-b465-4b9db6f2aeeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:57:55.747824 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:57:55.807785 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e51291-05ad-4099-b465-4b9db6f2aeeb None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:57:55.894165 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75deb72-1c92-4139-a3b4-4666fd5e9e19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5525865e12c41fe8da761cd25c14e2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:57:55.894940 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75deb72-1c92-4139-a3b4-4666fd5e9e19 service cinder] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:57:55.895394 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75deb72-1c92-4139-a3b4-4666fd5e9e19 service cinder] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:57:55.895743 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75deb72-1c92-4139-a3b4-4666fd5e9e19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:57:55.897479 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-f75deb72-1c92-4139-a3b4-4666fd5e9e19 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:57:56.017723 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:57:56.034967 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75deb72-1c92-4139-a3b4-4666fd5e9e19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:57:56.036557 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75deb72-1c92-4139-a3b4-4666fd5e9e19 service cinder] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:57:56.050354 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b78b4-d3af-402b-8447-5464465927c9 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:57:56.050898 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b78b4-d3af-402b-8447-5464465927c9 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:57:56.050898 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b78b4-d3af-402b-8447-5464465927c9 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:57:56.056260 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 689/1373] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:57:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:57:56.057320 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ea0d6-15ce-4bee-a4de-95de84633570 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:57:56.057475 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ea0d6-15ce-4bee-a4de-95de84633570 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:57:56.057787 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ea0d6-15ce-4bee-a4de-95de84633570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:57:56.058277 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 685/1374] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 18:57:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:57:56.134995 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-629ea0d6-15ce-4bee-a4de-95de84633570 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:57:56.136099 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-629ea0d6-15ce-4bee-a4de-95de84633570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:57:56.251848 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 690/1375] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:57:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:57:56.319965 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75deb72-1c92-4139-a3b4-4666fd5e9e19 service cinder] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:57:56.319965 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-f75deb72-1c92-4139-a3b4-4666fd5e9e19 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:57:56.430840 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75deb72-1c92-4139-a3b4-4666fd5e9e19 service cinder] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:57:56.530557 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:57:56.544043 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f93f9-62c0-43c3-9a1f-556dbc100d28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17fbef9db7734283aaad4962ee160171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:57:56.544657 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f93f9-62c0-43c3-9a1f-556dbc100d28 service nova] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:57:56.544935 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f93f9-62c0-43c3-9a1f-556dbc100d28 service nova] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:57:56.545205 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f93f9-62c0-43c3-9a1f-556dbc100d28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:57:56.546824 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-cf7f93f9-62c0-43c3-9a1f-556dbc100d28 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:57:56.636481 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7f93f9-62c0-43c3-9a1f-556dbc100d28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:57:56.638086 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7f93f9-62c0-43c3-9a1f-556dbc100d28 service nova] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:57:56.656521 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 686/1376] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 18:57:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:57:58.695026 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b08cc0-f9e3-4017-a180-03c92748d1fe None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:57:58.695583 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b08cc0-f9e3-4017-a180-03c92748d1fe None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:57:58.695583 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b08cc0-f9e3-4017-a180-03c92748d1fe None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:57:58.696941 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 691/1377] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:57:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:57:58.702248 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91795b0-e0dd-4af5-a7ea-a503b9c97ff9 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:57:58.702670 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91795b0-e0dd-4af5-a7ea-a503b9c97ff9 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:57:58.702868 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91795b0-e0dd-4af5-a7ea-a503b9c97ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:57:58.767939 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-b91795b0-e0dd-4af5-a7ea-a503b9c97ff9 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:57:58.769136 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-b91795b0-e0dd-4af5-a7ea-a503b9c97ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:57:58.830406 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:57:58.877189 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 687/1378] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:57:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:57:58.922844 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b08cc0-f9e3-4017-a180-03c92748d1fe None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:57:58.924432 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a6b08cc0-f9e3-4017-a180-03c92748d1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:57:58.987632 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:57:59.112658 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b08cc0-f9e3-4017-a180-03c92748d1fe None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:57:59.223433 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453561cd-0258-45ae-9fe5-af34f03e34fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17fbef9db7734283aaad4962ee160171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:57:59.224063 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453561cd-0258-45ae-9fe5-af34f03e34fb service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:57:59.224338 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453561cd-0258-45ae-9fe5-af34f03e34fb service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:57:59.224611 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453561cd-0258-45ae-9fe5-af34f03e34fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:57:59.226190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-453561cd-0258-45ae-9fe5-af34f03e34fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:57:59.237800 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:57:59.324735 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453561cd-0258-45ae-9fe5-af34f03e34fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:57:59.326311 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453561cd-0258-45ae-9fe5-af34f03e34fb service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:57:59.344710 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 692/1379] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 18:57:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:58:01.406011 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637834b0-f204-4f5d-a494-1788a7042516 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:01.406526 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637834b0-f204-4f5d-a494-1788a7042516 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:01.406631 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637834b0-f204-4f5d-a494-1788a7042516 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:01.410217 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 688/1380] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:58:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:58:01.413124 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2400736-0f88-4739-b63d-2a5303075013 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:01.413557 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2400736-0f88-4739-b63d-2a5303075013 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:01.413751 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2400736-0f88-4739-b63d-2a5303075013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:01.483907 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-e2400736-0f88-4739-b63d-2a5303075013 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:58:01.485103 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-e2400736-0f88-4739-b63d-2a5303075013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:01.588495 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:58:01.605144 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 693/1381] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:58:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:58:01.649444 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637834b0-f204-4f5d-a494-1788a7042516 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:58:01.650949 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-637834b0-f204-4f5d-a494-1788a7042516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:01.801870 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637834b0-f204-4f5d-a494-1788a7042516 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:58:01.857676 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:58:01.929872 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae081a4-e160-4bb5-87db-e78903ae9c02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17fbef9db7734283aaad4962ee160171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:58:01.930609 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae081a4-e160-4bb5-87db-e78903ae9c02 service nova] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:01.930960 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae081a4-e160-4bb5-87db-e78903ae9c02 service nova] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:01.931302 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae081a4-e160-4bb5-87db-e78903ae9c02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:01.933020 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-bae081a4-e160-4bb5-87db-e78903ae9c02 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:02.026588 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae081a4-e160-4bb5-87db-e78903ae9c02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:58:02.028302 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae081a4-e160-4bb5-87db-e78903ae9c02 service nova] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:58:02.047632 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 689/1382] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 18:58:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:58:04.091458 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a5aca-9f6a-4eae-aee5-debcd8596a7e None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:04.092239 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a5aca-9f6a-4eae-aee5-debcd8596a7e None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:04.092239 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a5aca-9f6a-4eae-aee5-debcd8596a7e None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:04.093449 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 694/1383] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:58:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:58:04.099283 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174d7bd-bea5-4a4d-852c-a6782faf03f7 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:04.099736 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174d7bd-bea5-4a4d-852c-a6782faf03f7 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:04.099961 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174d7bd-bea5-4a4d-852c-a6782faf03f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:04.170149 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-1174d7bd-bea5-4a4d-852c-a6782faf03f7 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:58:04.171495 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-1174d7bd-bea5-4a4d-852c-a6782faf03f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:04.173942 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:58:04.281204 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 690/1384] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:58:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:58:04.332885 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a5aca-9f6a-4eae-aee5-debcd8596a7e None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:58:04.334948 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-712a5aca-9f6a-4eae-aee5-debcd8596a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:04.488979 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a5aca-9f6a-4eae-aee5-debcd8596a7e None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:58:04.553383 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:58:04.617454 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7100c00-10d5-4103-abba-c0a889a2f795 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17fbef9db7734283aaad4962ee160171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:58:04.618520 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7100c00-10d5-4103-abba-c0a889a2f795 service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:04.619002 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7100c00-10d5-4103-abba-c0a889a2f795 service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:04.619485 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7100c00-10d5-4103-abba-c0a889a2f795 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:04.622293 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a7100c00-10d5-4103-abba-c0a889a2f795 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:04.728672 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7100c00-10d5-4103-abba-c0a889a2f795 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:58:04.730718 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7100c00-10d5-4103-abba-c0a889a2f795 service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:58:04.754346 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 695/1385] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 18:58:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:58:06.892943 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f22df-20a0-455b-8060-bb57d990bfbf None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:06.893488 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f22df-20a0-455b-8060-bb57d990bfbf None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:06.893591 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f22df-20a0-455b-8060-bb57d990bfbf None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:06.894970 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 691/1386] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:58:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:58:06.900928 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc66b6-f539-46b3-8ebb-08b12501120a None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:06.901489 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc66b6-f539-46b3-8ebb-08b12501120a None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:06.901489 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc66b6-f539-46b3-8ebb-08b12501120a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:06.982578 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-f6bc66b6-f539-46b3-8ebb-08b12501120a None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:58:06.983840 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-f6bc66b6-f539-46b3-8ebb-08b12501120a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:07.010261 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:58:07.091551 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 696/1387] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:58:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:58:07.136690 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f22df-20a0-455b-8060-bb57d990bfbf None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:58:07.138312 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-ab5f22df-20a0-455b-8060-bb57d990bfbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:07.286105 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:58:07.309727 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f22df-20a0-455b-8060-bb57d990bfbf None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:58:07.454218 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e907d-7914-4400-8faf-7b395129afec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17fbef9db7734283aaad4962ee160171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:58:07.455297 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e907d-7914-4400-8faf-7b395129afec service nova] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:07.455668 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e907d-7914-4400-8faf-7b395129afec service nova] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:07.456284 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e907d-7914-4400-8faf-7b395129afec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:07.458566 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-193e907d-7914-4400-8faf-7b395129afec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:07.566211 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193e907d-7914-4400-8faf-7b395129afec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:58:07.567743 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193e907d-7914-4400-8faf-7b395129afec service nova] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:58:07.572800 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:58:07.586594 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 692/1388] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 18:58:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:58:09.935749 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c61e45-121e-4a28-9ac0-53133b72e054 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:09.936320 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c61e45-121e-4a28-9ac0-53133b72e054 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:09.936320 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c61e45-121e-4a28-9ac0-53133b72e054 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:09.937652 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 697/1389] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:58:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:58:09.942788 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520beb2-b207-476f-8864-5cea2448fc83 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:09.943210 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520beb2-b207-476f-8864-5cea2448fc83 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:09.943414 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520beb2-b207-476f-8864-5cea2448fc83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:10.009628 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-0520beb2-b207-476f-8864-5cea2448fc83 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:58:10.010838 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-0520beb2-b207-476f-8864-5cea2448fc83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:10.110337 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 693/1390] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:58:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:58:10.157361 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c61e45-121e-4a28-9ac0-53133b72e054 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:58:10.158982 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-e4c61e45-121e-4a28-9ac0-53133b72e054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:10.303464 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c61e45-121e-4a28-9ac0-53133b72e054 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:58:10.312903 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:58:10.423204 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2efc3ec-fa97-4793-9043-508357ed28a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17fbef9db7734283aaad4962ee160171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:58:10.423854 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2efc3ec-fa97-4793-9043-508357ed28a1 service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:10.424128 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2efc3ec-fa97-4793-9043-508357ed28a1 service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:10.424396 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2efc3ec-fa97-4793-9043-508357ed28a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:10.426015 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-e2efc3ec-fa97-4793-9043-508357ed28a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:10.516528 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2efc3ec-fa97-4793-9043-508357ed28a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:58:10.518139 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2efc3ec-fa97-4793-9043-508357ed28a1 service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:58:10.536777 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 698/1391] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 18:58:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:58:11.649944 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e07645-b6ba-4e0e-9e0b-1d8df9b25223 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:11.650487 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e07645-b6ba-4e0e-9e0b-1d8df9b25223 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:11.650487 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e07645-b6ba-4e0e-9e0b-1d8df9b25223 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:11.651934 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 694/1392] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:58:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:58:11.657138 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeddfaf-f80b-426b-bd02-cc915d04bf2d None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:11.657579 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeddfaf-f80b-426b-bd02-cc915d04bf2d None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:11.657676 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeddfaf-f80b-426b-bd02-cc915d04bf2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:11.673024 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:58:11.726150 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-3eeddfaf-f80b-426b-bd02-cc915d04bf2d None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:58:11.727369 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-3eeddfaf-f80b-426b-bd02-cc915d04bf2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:11.842639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 699/1393] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:58:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:58:11.906661 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fc597-8ab9-49e2-b398-048602b36369 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:11.907039 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fc597-8ab9-49e2-b398-048602b36369 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:11.907371 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fc597-8ab9-49e2-b398-048602b36369 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:11.908993 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 695/1394] 10.222.0.20 () {54 vars in 966 bytes} [Wed Jul 27 18:58:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:58:11.918384 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22bd026-44fa-4851-bb63-f28ecc760998 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:11.918760 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22bd026-44fa-4851-bb63-f28ecc760998 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:11.918760 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22bd026-44fa-4851-bb63-f28ecc760998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:11.999570 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-f22bd026-44fa-4851-bb63-f28ecc760998 None None] MFA Rules not processed for user `6c4b9109e80b4ae19a7c31de1cd9d2b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:58:12.000792 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-f22bd026-44fa-4851-bb63-f28ecc760998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:12.034089 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:58:12.076033 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 700/1395] 10.222.0.20 () {58 vars in 1063 bytes} [Wed Jul 27 18:58:11 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:58:12.083469 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0fc597-8ab9-49e2-b398-048602b36369 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:58:12.085082 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-0e0fc597-8ab9-49e2-b398-048602b36369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:12.162595 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:58:12.196343 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0fc597-8ab9-49e2-b398-048602b36369 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:58:12.270451 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d55b8e-1f97-4068-a710-2af4f5e34c36 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c4b9109e80b4ae19a7c31de1cd9d2b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:58:12.271070 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d55b8e-1f97-4068-a710-2af4f5e34c36 service glance] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:12.271353 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d55b8e-1f97-4068-a710-2af4f5e34c36 service glance] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:12.271629 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d55b8e-1f97-4068-a710-2af4f5e34c36 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:12.273299 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-c6d55b8e-1f97-4068-a710-2af4f5e34c36 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:12.383348 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d55b8e-1f97-4068-a710-2af4f5e34c36 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:58:12.384812 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d55b8e-1f97-4068-a710-2af4f5e34c36 service glance] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:58:12.400325 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:58:12.405357 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 696/1396] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 18:58:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:58:12.619086 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4173080-2dd9-472f-b476-6f40c4483036 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:12.619377 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4173080-2dd9-472f-b476-6f40c4483036 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:12.619662 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4173080-2dd9-472f-b476-6f40c4483036 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:12.621183 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 701/1397] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:58:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:58:12.627131 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa267eef-3f10-4032-8f1b-5b993be874b5 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:12.627414 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa267eef-3f10-4032-8f1b-5b993be874b5 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:12.627709 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa267eef-3f10-4032-8f1b-5b993be874b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:12.701099 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-aa267eef-3f10-4032-8f1b-5b993be874b5 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:58:12.702382 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-aa267eef-3f10-4032-8f1b-5b993be874b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:12.808802 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 697/1398] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:58:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:58:12.852902 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4173080-2dd9-472f-b476-6f40c4483036 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:58:12.854396 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-c4173080-2dd9-472f-b476-6f40c4483036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:13.016473 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4173080-2dd9-472f-b476-6f40c4483036 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:58:13.064157 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:58:13.140155 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a0232-6128-454c-a21c-b89363da88e9 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:13.140470 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a0232-6128-454c-a21c-b89363da88e9 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:13.140772 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a0232-6128-454c-a21c-b89363da88e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:13.143171 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c269c-4d4e-4456-a561-a9ab677236a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17fbef9db7734283aaad4962ee160171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:58:13.143815 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c269c-4d4e-4456-a561-a9ab677236a9 service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:13.144101 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c269c-4d4e-4456-a561-a9ab677236a9 service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:13.144373 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c269c-4d4e-4456-a561-a9ab677236a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:13.146383 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-3a9c269c-4d4e-4456-a561-a9ab677236a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:13.206456 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-b99a0232-6128-454c-a21c-b89363da88e9 None None] MFA Rules not processed for user `a277ddae777442869114c4c5deff7d7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:58:13.207716 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-b99a0232-6128-454c-a21c-b89363da88e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:13.235394 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9c269c-4d4e-4456-a561-a9ab677236a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:58:13.236478 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:58:13.237021 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9c269c-4d4e-4456-a561-a9ab677236a9 service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:58:13.256561 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 702/1399] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 18:58:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:58:13.297428 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 698/1400] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Jul 27 18:58:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:58:13.341766 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58bf98d-7d0c-45c6-9753-c257200d5196 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:13.342058 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58bf98d-7d0c-45c6-9753-c257200d5196 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:13.342336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58bf98d-7d0c-45c6-9753-c257200d5196 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:13.343797 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 703/1401] 10.222.0.20 () {54 vars in 943 bytes} [Wed Jul 27 18:58:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:58:13.350858 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e20c8-ac85-42a4-adc7-498f564a158c None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:13.351145 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e20c8-ac85-42a4-adc7-498f564a158c None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:13.351422 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e20c8-ac85-42a4-adc7-498f564a158c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:13.438599 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-dd8e20c8-ac85-42a4-adc7-498f564a158c None None] MFA Rules not processed for user `16a9f1909ab3458c8c131986e303831a`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:58:13.440077 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-dd8e20c8-ac85-42a4-adc7-498f564a158c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:13.553328 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 699/1402] 10.222.0.20 () {58 vars in 1040 bytes} [Wed Jul 27 18:58:13 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:58:13.563122 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58bf98d-7d0c-45c6-9753-c257200d5196 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:58:13.564677 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-e58bf98d-7d0c-45c6-9753-c257200d5196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:13.613376 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:58:13.702132 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58bf98d-7d0c-45c6-9753-c257200d5196 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:58:13.805830 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad80cec-2c9d-4f4d-abad-32cca40b6873 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a9f1909ab3458c8c131986e303831a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:58:13.806605 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad80cec-2c9d-4f4d-abad-32cca40b6873 service swift] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:13.806889 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad80cec-2c9d-4f4d-abad-32cca40b6873 service swift] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:13.807163 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad80cec-2c9d-4f4d-abad-32cca40b6873 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:13.808872 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-7ad80cec-2c9d-4f4d-abad-32cca40b6873 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:13.840324 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:58:13.893058 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad80cec-2c9d-4f4d-abad-32cca40b6873 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:58:13.894559 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad80cec-2c9d-4f4d-abad-32cca40b6873 service swift] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:58:13.903064 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 704/1403] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Jul 27 18:58:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 18:58:15.357091 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0073d8-cf65-45a4-b95b-bf308868434f None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:15.357881 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0073d8-cf65-45a4-b95b-bf308868434f None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:15.357881 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0073d8-cf65-45a4-b95b-bf308868434f None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:15.359711 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 700/1404] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:58:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:58:15.364815 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c196811-de70-449f-b93f-7084d9b29647 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:15.365272 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c196811-de70-449f-b93f-7084d9b29647 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:15.365370 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c196811-de70-449f-b93f-7084d9b29647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:15.445930 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-3c196811-de70-449f-b93f-7084d9b29647 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:58:15.447185 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-3c196811-de70-449f-b93f-7084d9b29647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:15.565992 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 705/1405] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:58:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:58:15.612429 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0073d8-cf65-45a4-b95b-bf308868434f None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:58:15.613884 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-db0073d8-cf65-45a4-b95b-bf308868434f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:15.617109 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:58:15.813420 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0073d8-cf65-45a4-b95b-bf308868434f None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:58:15.902912 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:58:15.944841 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee002d10-f4e4-4936-a8dd-5ca4ebd0f7d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17fbef9db7734283aaad4962ee160171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:58:15.945459 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee002d10-f4e4-4936-a8dd-5ca4ebd0f7d3 service nova] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:15.946355 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee002d10-f4e4-4936-a8dd-5ca4ebd0f7d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:15.946631 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee002d10-f4e4-4936-a8dd-5ca4ebd0f7d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:15.948312 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-ee002d10-f4e4-4936-a8dd-5ca4ebd0f7d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:16.050890 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee002d10-f4e4-4936-a8dd-5ca4ebd0f7d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:58:16.052528 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee002d10-f4e4-4936-a8dd-5ca4ebd0f7d3 service nova] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:58:16.072191 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 701/1406] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 18:58:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:58:18.156874 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de680bf3-f697-4912-bdce-018341c4bcba None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:18.157490 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de680bf3-f697-4912-bdce-018341c4bcba None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:18.157490 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de680bf3-f697-4912-bdce-018341c4bcba None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:18.159385 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 706/1407] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:58:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:58:18.165358 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aec466-63ad-4e8d-bdb1-52f707e8262d None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:18.165919 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aec466-63ad-4e8d-bdb1-52f707e8262d None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:18.165919 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aec466-63ad-4e8d-bdb1-52f707e8262d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:18.264125 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-a3aec466-63ad-4e8d-bdb1-52f707e8262d None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:58:18.265937 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-a3aec466-63ad-4e8d-bdb1-52f707e8262d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:18.308803 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:58:18.375328 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 702/1408] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:58:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:58:18.420428 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de680bf3-f697-4912-bdce-018341c4bcba None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:58:18.421948 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-de680bf3-f697-4912-bdce-018341c4bcba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:18.451443 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:58:18.593949 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de680bf3-f697-4912-bdce-018341c4bcba None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:58:18.700660 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:58:18.726081 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6536159-7b98-419d-bf3e-f75294c82c03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17fbef9db7734283aaad4962ee160171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:58:18.726835 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6536159-7b98-419d-bf3e-f75294c82c03 service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:18.727176 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6536159-7b98-419d-bf3e-f75294c82c03 service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:18.727532 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6536159-7b98-419d-bf3e-f75294c82c03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:18.729910 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-e6536159-7b98-419d-bf3e-f75294c82c03 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:18.835197 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6536159-7b98-419d-bf3e-f75294c82c03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:58:18.837496 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6536159-7b98-419d-bf3e-f75294c82c03 service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:58:18.857736 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 707/1409] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 18:58:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:58:28.373231 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=26 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:58:28.854228 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=52 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:58:36.116147 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5c691-dbab-447b-a2b9-9bb13f50e2ef None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:36.116739 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5c691-dbab-447b-a2b9-9bb13f50e2ef None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:36.116739 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5c691-dbab-447b-a2b9-9bb13f50e2ef None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:36.118059 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 703/1410] 10.222.0.20 () {54 vars in 918 bytes} [Wed Jul 27 18:58:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:58:36.123050 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4a5d4-ab23-4618-b693-2e586f0e3949 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:36.123514 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4a5d4-ab23-4618-b693-2e586f0e3949 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:36.123631 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4a5d4-ab23-4618-b693-2e586f0e3949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:36.204374 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-68b4a5d4-ab23-4618-b693-2e586f0e3949 None None] MFA Rules not processed for user `3b0382b170fb49e785a57bbb329d4b37`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:58:36.205598 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-68b4a5d4-ab23-4618-b693-2e586f0e3949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:36.311786 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 708/1411] 10.222.0.20 () {58 vars in 1015 bytes} [Wed Jul 27 18:58:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:58:36.326393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526300c3-1dc9-465c-b6ad-31c878530e7b None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:36.326679 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526300c3-1dc9-465c-b6ad-31c878530e7b None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:36.326956 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526300c3-1dc9-465c-b6ad-31c878530e7b None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:36.328365 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 704/1412] 10.222.0.20 () {54 vars in 918 bytes} [Wed Jul 27 18:58:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:58:36.333034 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dc708-99c3-4768-b640-13fd45787bd6 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:36.333320 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dc708-99c3-4768-b640-13fd45787bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:36.333593 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dc708-99c3-4768-b640-13fd45787bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:36.406367 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:58:36.410555 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-097dc708-99c3-4768-b640-13fd45787bd6 None None] MFA Rules not processed for user `17fbef9db7734283aaad4962ee160171`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:58:36.412309 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-097dc708-99c3-4768-b640-13fd45787bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:36.526247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 709/1413] 10.222.0.20 () {58 vars in 1015 bytes} [Wed Jul 27 18:58:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:58:38.977697 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f8919-e2ae-477c-9d49-1f9fdbd0bdf5 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:38.978259 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f8919-e2ae-477c-9d49-1f9fdbd0bdf5 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:38.978259 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f8919-e2ae-477c-9d49-1f9fdbd0bdf5 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:38.979612 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 705/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 18:58:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:58:38.985173 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b1ffb-38e7-4dbf-b081-2eee08d0265f None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:38.985574 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b1ffb-38e7-4dbf-b081-2eee08d0265f None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:38.985732 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b1ffb-38e7-4dbf-b081-2eee08d0265f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:39.051112 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-aa3b1ffb-38e7-4dbf-b081-2eee08d0265f None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:58:39.052341 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-aa3b1ffb-38e7-4dbf-b081-2eee08d0265f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:39.107090 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:58:39.149881 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 710/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 18:58:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:58:39.192379 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f8919-e2ae-477c-9d49-1f9fdbd0bdf5 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:58:39.194008 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-875f8919-e2ae-477c-9d49-1f9fdbd0bdf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:39.337483 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f8919-e2ae-477c-9d49-1f9fdbd0bdf5 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:58:39.408765 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:58:39.449028 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeaf31f-41d1-4d42-8e80-f2416d0bd4cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17fbef9db7734283aaad4962ee160171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:58:39.449668 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeaf31f-41d1-4d42-8e80-f2416d0bd4cd service nova] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:39.449950 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeaf31f-41d1-4d42-8e80-f2416d0bd4cd service nova] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:39.450221 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeaf31f-41d1-4d42-8e80-f2416d0bd4cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:39.451881 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-eaeaf31f-41d1-4d42-8e80-f2416d0bd4cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:39.538728 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeaf31f-41d1-4d42-8e80-f2416d0bd4cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:58:39.541366 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeaf31f-41d1-4d42-8e80-f2416d0bd4cd service nova] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:58:39.561419 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 706/1416] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 18:58:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:58:40.494705 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ab256-3194-4dc1-a294-40480728a82f None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:40.495281 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ab256-3194-4dc1-a294-40480728a82f None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:40.495281 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ab256-3194-4dc1-a294-40480728a82f None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:40.496677 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 711/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 18:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:58:40.501718 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d09ffe-464e-416d-ac8a-1e38302af9bb None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:40.502113 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d09ffe-464e-416d-ac8a-1e38302af9bb None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:40.502269 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d09ffe-464e-416d-ac8a-1e38302af9bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:40.578888 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-d8d09ffe-464e-416d-ac8a-1e38302af9bb None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:58:40.580127 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-d8d09ffe-464e-416d-ac8a-1e38302af9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:40.606645 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:58:40.678906 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 707/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 18:58:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:58:40.830190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ab256-3194-4dc1-a294-40480728a82f None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:58:40.831758 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-092ab256-3194-4dc1-a294-40480728a82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:40.973289 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ab256-3194-4dc1-a294-40480728a82f None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:58:41.014000 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:58:41.085486 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe078ca-89ef-4c56-8c95-f0ccfa17dbad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17fbef9db7734283aaad4962ee160171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:58:41.086053 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe078ca-89ef-4c56-8c95-f0ccfa17dbad service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:41.086347 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe078ca-89ef-4c56-8c95-f0ccfa17dbad service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:41.086599 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe078ca-89ef-4c56-8c95-f0ccfa17dbad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:41.088238 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-5fe078ca-89ef-4c56-8c95-f0ccfa17dbad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:41.175381 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe078ca-89ef-4c56-8c95-f0ccfa17dbad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:58:41.177001 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe078ca-89ef-4c56-8c95-f0ccfa17dbad service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:58:41.195757 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 712/1419] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 18:58:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:58:42.082291 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560093c-5e0d-4929-b66a-e6c0235e82ef None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:42.082837 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560093c-5e0d-4929-b66a-e6c0235e82ef None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:42.082837 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560093c-5e0d-4929-b66a-e6c0235e82ef None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:42.084225 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 708/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 18:58:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:58:42.089158 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087f7ba-87b2-40c1-b52e-635193c4c17f None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:42.089610 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087f7ba-87b2-40c1-b52e-635193c4c17f None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:42.089721 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087f7ba-87b2-40c1-b52e-635193c4c17f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:42.144125 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:58:42.165676 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-2087f7ba-87b2-40c1-b52e-635193c4c17f None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:58:42.166886 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-2087f7ba-87b2-40c1-b52e-635193c4c17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:42.263944 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 713/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 18:58:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:58:42.415836 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6560093c-5e0d-4929-b66a-e6c0235e82ef None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:58:42.417382 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-6560093c-5e0d-4929-b66a-e6c0235e82ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:42.560007 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6560093c-5e0d-4929-b66a-e6c0235e82ef None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:58:42.572205 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:58:42.670504 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb8233-eb04-4e85-b081-94a4d20c7d4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17fbef9db7734283aaad4962ee160171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:58:42.671044 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb8233-eb04-4e85-b081-94a4d20c7d4a service nova] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:42.671325 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb8233-eb04-4e85-b081-94a4d20c7d4a service nova] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:42.671599 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb8233-eb04-4e85-b081-94a4d20c7d4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:42.673257 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-fcfb8233-eb04-4e85-b081-94a4d20c7d4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:42.762016 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb8233-eb04-4e85-b081-94a4d20c7d4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:58:42.764020 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb8233-eb04-4e85-b081-94a4d20c7d4a service nova] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:58:42.781407 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 709/1422] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 18:58:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:58:43.644580 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1fa22-822e-467a-b504-368f784b3bdd None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:43.645101 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1fa22-822e-467a-b504-368f784b3bdd None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:43.645233 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1fa22-822e-467a-b504-368f784b3bdd None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:43.646480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 714/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 18:58:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:58:43.651370 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac1cb3-4a98-4269-bddc-e609fee6a7ea None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:43.651795 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac1cb3-4a98-4269-bddc-e609fee6a7ea None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:43.651953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac1cb3-4a98-4269-bddc-e609fee6a7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:43.671887 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:58:43.731186 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-feac1cb3-4a98-4269-bddc-e609fee6a7ea None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:58:43.732480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-feac1cb3-4a98-4269-bddc-e609fee6a7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:43.838318 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 710/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 18:58:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:58:43.992032 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f1fa22-822e-467a-b504-368f784b3bdd None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:58:43.993544 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-f7f1fa22-822e-467a-b504-368f784b3bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:44.102098 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:58:44.139022 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f1fa22-822e-467a-b504-368f784b3bdd None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:58:44.251285 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dcc8ac-c597-4c3b-9726-3570d1166afc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17fbef9db7734283aaad4962ee160171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:58:44.251918 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dcc8ac-c597-4c3b-9726-3570d1166afc service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:44.252231 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dcc8ac-c597-4c3b-9726-3570d1166afc service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:44.252512 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dcc8ac-c597-4c3b-9726-3570d1166afc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:44.254237 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-08dcc8ac-c597-4c3b-9726-3570d1166afc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:44.330798 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:58:44.346544 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dcc8ac-c597-4c3b-9726-3570d1166afc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:58:44.348207 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dcc8ac-c597-4c3b-9726-3570d1166afc service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:58:44.366594 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 715/1425] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 18:58:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:58:45.215373 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1390e7-537e-454d-b3d3-74211f335f72 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:45.215961 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1390e7-537e-454d-b3d3-74211f335f72 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:45.215961 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1390e7-537e-454d-b3d3-74211f335f72 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:45.217316 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 711/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 18:58:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:58:45.222259 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6bf22-261c-46ef-a6dc-4fa1a84a54e8 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:45.222669 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6bf22-261c-46ef-a6dc-4fa1a84a54e8 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:45.222821 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6bf22-261c-46ef-a6dc-4fa1a84a54e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:45.298669 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-ccf6bf22-261c-46ef-a6dc-4fa1a84a54e8 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:58:45.299893 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-ccf6bf22-261c-46ef-a6dc-4fa1a84a54e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:45.394414 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 716/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 18:58:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:58:45.546096 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1390e7-537e-454d-b3d3-74211f335f72 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:58:45.547640 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-df1390e7-537e-454d-b3d3-74211f335f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:45.629823 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:58:45.700004 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1390e7-537e-454d-b3d3-74211f335f72 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:58:45.810923 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f3a89d-9e4a-432b-9235-8879250f9065 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17fbef9db7734283aaad4962ee160171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:58:45.811541 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3a89d-9e4a-432b-9235-8879250f9065 service nova] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:45.811857 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3a89d-9e4a-432b-9235-8879250f9065 service nova] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:45.812133 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3a89d-9e4a-432b-9235-8879250f9065 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:45.813743 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-a6f3a89d-9e4a-432b-9235-8879250f9065 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:45.861181 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:58:45.902448 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f3a89d-9e4a-432b-9235-8879250f9065 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:58:45.904125 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f3a89d-9e4a-432b-9235-8879250f9065 service nova] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:58:45.921723 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 712/1428] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 18:58:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:58:46.728739 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae2524-e779-4ac7-ba98-884988dc514f None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:46.729275 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae2524-e779-4ac7-ba98-884988dc514f None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:46.729275 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae2524-e779-4ac7-ba98-884988dc514f None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:46.730632 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 717/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 18:58:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:58:46.735861 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f23381-2080-43c8-943a-cfcb604da7e0 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:46.736307 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f23381-2080-43c8-943a-cfcb604da7e0 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:46.736412 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f23381-2080-43c8-943a-cfcb604da7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:46.811820 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-75f23381-2080-43c8-943a-cfcb604da7e0 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:58:46.812941 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-75f23381-2080-43c8-943a-cfcb604da7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:46.905824 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 713/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 18:58:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:58:47.059074 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae2524-e779-4ac7-ba98-884988dc514f None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:58:47.060631 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-43ae2524-e779-4ac7-ba98-884988dc514f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:47.109103 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:58:47.204220 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae2524-e779-4ac7-ba98-884988dc514f None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:58:47.315856 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e37c1e1-fd31-42e9-844a-de7942c9ff5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17fbef9db7734283aaad4962ee160171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:58:47.316395 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37c1e1-fd31-42e9-844a-de7942c9ff5e service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:47.316675 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37c1e1-fd31-42e9-844a-de7942c9ff5e service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:47.316946 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37c1e1-fd31-42e9-844a-de7942c9ff5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:47.319955 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-7e37c1e1-fd31-42e9-844a-de7942c9ff5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:47.329540 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:58:47.416421 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e37c1e1-fd31-42e9-844a-de7942c9ff5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:58:47.418013 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e37c1e1-fd31-42e9-844a-de7942c9ff5e service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:58:47.436254 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 718/1431] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 18:58:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:58:48.231131 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11955b-4559-4b24-a692-10dff1bac986 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:48.231747 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11955b-4559-4b24-a692-10dff1bac986 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:48.231747 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11955b-4559-4b24-a692-10dff1bac986 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:48.233062 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 714/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 18:58:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:58:48.238271 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c4f5d-032d-4caf-9a3d-437d6be62472 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:48.238669 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c4f5d-032d-4caf-9a3d-437d6be62472 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:48.238831 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c4f5d-032d-4caf-9a3d-437d6be62472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:48.314269 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-e94c4f5d-032d-4caf-9a3d-437d6be62472 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:58:48.315469 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-e94c4f5d-032d-4caf-9a3d-437d6be62472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:48.382697 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:58:48.413380 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 719/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 18:58:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:58:48.564707 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e11955b-4559-4b24-a692-10dff1bac986 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:58:48.566219 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-8e11955b-4559-4b24-a692-10dff1bac986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:48.583758 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:58:48.707804 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e11955b-4559-4b24-a692-10dff1bac986 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:58:48.791679 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:58:48.817726 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f1440-efbf-4113-8a43-740d91b20ed9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17fbef9db7734283aaad4962ee160171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:58:48.818371 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f1440-efbf-4113-8a43-740d91b20ed9 service nova] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:48.818652 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f1440-efbf-4113-8a43-740d91b20ed9 service nova] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:48.818925 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f1440-efbf-4113-8a43-740d91b20ed9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:48.821182 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-216f1440-efbf-4113-8a43-740d91b20ed9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:48.908545 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216f1440-efbf-4113-8a43-740d91b20ed9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:58:48.910124 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216f1440-efbf-4113-8a43-740d91b20ed9 service nova] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:58:48.927464 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 715/1434] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 18:58:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:58:49.723747 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1406f-8cfc-478a-91ca-b0db600812d8 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:49.724319 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1406f-8cfc-478a-91ca-b0db600812d8 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:49.724319 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1406f-8cfc-478a-91ca-b0db600812d8 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:49.725665 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 720/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 18:58:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:58:49.730652 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87278a-a1ca-4c31-9089-ebda3395d61d None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:49.731079 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87278a-a1ca-4c31-9089-ebda3395d61d None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:49.731186 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87278a-a1ca-4c31-9089-ebda3395d61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:49.805916 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-ae87278a-a1ca-4c31-9089-ebda3395d61d None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:58:49.807027 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-ae87278a-a1ca-4c31-9089-ebda3395d61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:49.966574 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:58:50.025024 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 716/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 18:58:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:58:50.174855 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa1406f-8cfc-478a-91ca-b0db600812d8 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:58:50.176402 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-ffa1406f-8cfc-478a-91ca-b0db600812d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:50.320961 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa1406f-8cfc-478a-91ca-b0db600812d8 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:58:50.374264 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:58:50.434748 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76eb77-4414-43bb-94dc-4bdeee04111c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17fbef9db7734283aaad4962ee160171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:58:50.435283 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76eb77-4414-43bb-94dc-4bdeee04111c service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:50.435563 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76eb77-4414-43bb-94dc-4bdeee04111c service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:50.435913 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76eb77-4414-43bb-94dc-4bdeee04111c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:50.438329 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-6c76eb77-4414-43bb-94dc-4bdeee04111c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:50.526462 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76eb77-4414-43bb-94dc-4bdeee04111c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:58:50.528132 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76eb77-4414-43bb-94dc-4bdeee04111c service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:58:50.545972 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 721/1437] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 18:58:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:58:51.351124 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3130b3f-acbc-48b2-a1a4-199eb5a13221 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:51.351643 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3130b3f-acbc-48b2-a1a4-199eb5a13221 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:51.351643 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3130b3f-acbc-48b2-a1a4-199eb5a13221 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:51.352944 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 717/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 18:58:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:58:51.357783 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10d151-b09f-4c15-be53-b4f9211e8b63 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:51.358491 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10d151-b09f-4c15-be53-b4f9211e8b63 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:51.358638 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10d151-b09f-4c15-be53-b4f9211e8b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:51.433572 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-4a10d151-b09f-4c15-be53-b4f9211e8b63 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:58:51.434784 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-4a10d151-b09f-4c15-be53-b4f9211e8b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:51.436842 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:58:51.530640 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 722/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 18:58:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:58:51.679347 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3130b3f-acbc-48b2-a1a4-199eb5a13221 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:58:51.681521 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-b3130b3f-acbc-48b2-a1a4-199eb5a13221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:51.819967 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3130b3f-acbc-48b2-a1a4-199eb5a13221 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:58:51.845338 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:58:51.930861 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997cd5a1-1e3c-4a6b-b974-5b469290c455 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17fbef9db7734283aaad4962ee160171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:58:51.931413 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cd5a1-1e3c-4a6b-b974-5b469290c455 service nova] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:51.931715 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cd5a1-1e3c-4a6b-b974-5b469290c455 service nova] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:51.931987 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cd5a1-1e3c-4a6b-b974-5b469290c455 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:51.933594 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-997cd5a1-1e3c-4a6b-b974-5b469290c455 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:52.019467 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997cd5a1-1e3c-4a6b-b974-5b469290c455 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:58:52.021072 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997cd5a1-1e3c-4a6b-b974-5b469290c455 service nova] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:58:52.038977 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 718/1440] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 18:58:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:58:53.939032 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa81311-d9f3-46bf-be07-93da82032614 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:53.939604 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa81311-d9f3-46bf-be07-93da82032614 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:53.939604 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa81311-d9f3-46bf-be07-93da82032614 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:53.940961 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 723/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 18:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:58:53.946588 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365ce41-a194-4c33-b50a-f5795942b2e2 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:53.946987 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365ce41-a194-4c33-b50a-f5795942b2e2 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:53.947135 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365ce41-a194-4c33-b50a-f5795942b2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:53.991138 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:58:54.016079 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-c365ce41-a194-4c33-b50a-f5795942b2e2 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:58:54.017286 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-c365ce41-a194-4c33-b50a-f5795942b2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:54.112051 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 719/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 18:58:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:58:54.150185 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa81311-d9f3-46bf-be07-93da82032614 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:58:54.151791 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-1fa81311-d9f3-46bf-be07-93da82032614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:54.254706 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa81311-d9f3-46bf-be07-93da82032614 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:58:54.286792 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:58:54.328213 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7735d851-48db-486d-bb9f-aceae1f39c84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703f0431d017405d942539de93a565b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:58:54.328819 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735d851-48db-486d-bb9f-aceae1f39c84 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:54.329094 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735d851-48db-486d-bb9f-aceae1f39c84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:54.329362 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735d851-48db-486d-bb9f-aceae1f39c84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:54.330968 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-7735d851-48db-486d-bb9f-aceae1f39c84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:54.438236 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7735d851-48db-486d-bb9f-aceae1f39c84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:58:54.439658 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7735d851-48db-486d-bb9f-aceae1f39c84 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:58:54.457754 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 724/1443] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 18:58:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:58:56.657064 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922cdc9-6517-467f-8062-604cb5ce2268 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:56.657623 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922cdc9-6517-467f-8062-604cb5ce2268 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:56.657623 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922cdc9-6517-467f-8062-604cb5ce2268 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:56.658950 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 720/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 18:58:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:58:56.664105 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd10226-0de2-4dca-80b1-c4050f9df884 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:56.664588 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd10226-0de2-4dca-80b1-c4050f9df884 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:56.665204 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd10226-0de2-4dca-80b1-c4050f9df884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:56.735870 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-3bd10226-0de2-4dca-80b1-c4050f9df884 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:58:56.737092 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-3bd10226-0de2-4dca-80b1-c4050f9df884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:56.749898 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:58:56.833240 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 725/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 18:58:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:58:56.871639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8922cdc9-6517-467f-8062-604cb5ce2268 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:58:56.873227 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-8922cdc9-6517-467f-8062-604cb5ce2268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:56.973657 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8922cdc9-6517-467f-8062-604cb5ce2268 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:58:56.985506 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:58:57.046240 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eebd30-be7b-4c5b-ba2e-c110f6bac752 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703f0431d017405d942539de93a565b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:58:57.046864 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eebd30-be7b-4c5b-ba2e-c110f6bac752 service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:57.047145 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eebd30-be7b-4c5b-ba2e-c110f6bac752 service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:57.047415 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eebd30-be7b-4c5b-ba2e-c110f6bac752 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:57.049132 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-35eebd30-be7b-4c5b-ba2e-c110f6bac752 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:57.159427 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eebd30-be7b-4c5b-ba2e-c110f6bac752 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:58:57.160811 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eebd30-be7b-4c5b-ba2e-c110f6bac752 service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:58:57.178204 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 721/1446] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 18:58:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:58:59.488990 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c310ca-5d45-490f-9dc1-e11b8c1b1602 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:59.489566 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c310ca-5d45-490f-9dc1-e11b8c1b1602 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:59.489566 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c310ca-5d45-490f-9dc1-e11b8c1b1602 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:59.490888 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 726/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 18:58:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:58:59.496655 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace237e7-9eea-413a-861c-629d887d5103 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:59.497105 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace237e7-9eea-413a-861c-629d887d5103 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:59.497213 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace237e7-9eea-413a-861c-629d887d5103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:59.544540 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:58:59.562411 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-ace237e7-9eea-413a-861c-629d887d5103 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:58:59.563596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-ace237e7-9eea-413a-861c-629d887d5103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:59.659959 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 722/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 18:58:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:58:59.698894 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c310ca-5d45-490f-9dc1-e11b8c1b1602 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:58:59.700459 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-20c310ca-5d45-490f-9dc1-e11b8c1b1602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:59.799815 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c310ca-5d45-490f-9dc1-e11b8c1b1602 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:58:59.839220 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:58:59.873085 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8852dc10-6106-448d-ad9d-e0fe3f6fdec4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703f0431d017405d942539de93a565b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:58:59.873686 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852dc10-6106-448d-ad9d-e0fe3f6fdec4 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:59.873960 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852dc10-6106-448d-ad9d-e0fe3f6fdec4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:59.874227 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852dc10-6106-448d-ad9d-e0fe3f6fdec4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:59.875854 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-8852dc10-6106-448d-ad9d-e0fe3f6fdec4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:59.980300 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8852dc10-6106-448d-ad9d-e0fe3f6fdec4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:58:59.981705 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8852dc10-6106-448d-ad9d-e0fe3f6fdec4 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:59:00.000077 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 727/1449] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 18:58:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:59:02.109972 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c853f-13b4-43b6-b777-a9a4c7409bae None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:59:02.110519 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c853f-13b4-43b6-b777-a9a4c7409bae None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:59:02.110519 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c853f-13b4-43b6-b777-a9a4c7409bae None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:59:02.111918 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 723/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 18:59:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:59:02.117805 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3471cf-0fc5-41d6-867f-26e2acc53169 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:59:02.118232 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3471cf-0fc5-41d6-867f-26e2acc53169 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:59:02.118429 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3471cf-0fc5-41d6-867f-26e2acc53169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:59:02.184274 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-7b3471cf-0fc5-41d6-867f-26e2acc53169 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:59:02.185471 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-7b3471cf-0fc5-41d6-867f-26e2acc53169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:59:02.205583 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:59:02.282173 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 728/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 18:59:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:59:02.322161 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c853f-13b4-43b6-b777-a9a4c7409bae None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:59:02.323678 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-516c853f-13b4-43b6-b777-a9a4c7409bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:59:02.426093 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c853f-13b4-43b6-b777-a9a4c7409bae None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:59:02.445681 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:59:02.498329 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff16e5c4-a3cc-4c45-a444-f3981a58708a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703f0431d017405d942539de93a565b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:59:02.498932 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16e5c4-a3cc-4c45-a444-f3981a58708a service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:59:02.499210 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16e5c4-a3cc-4c45-a444-f3981a58708a service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:59:02.499482 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16e5c4-a3cc-4c45-a444-f3981a58708a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:59:02.501138 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-ff16e5c4-a3cc-4c45-a444-f3981a58708a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:59:02.615188 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff16e5c4-a3cc-4c45-a444-f3981a58708a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:59:02.616690 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff16e5c4-a3cc-4c45-a444-f3981a58708a service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:59:02.634438 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 724/1452] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 18:59:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:59:04.703317 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19eb86-9d50-4f22-85e7-fc2b82a87dd1 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:59:04.703817 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19eb86-9d50-4f22-85e7-fc2b82a87dd1 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:59:04.703912 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19eb86-9d50-4f22-85e7-fc2b82a87dd1 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:59:04.705281 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 729/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 18:59:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:59:04.710495 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f1d80-749e-4eef-b2da-428e234d2082 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:59:04.710953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f1d80-749e-4eef-b2da-428e234d2082 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:59:04.711049 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f1d80-749e-4eef-b2da-428e234d2082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:59:04.773300 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:59:04.776316 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-7f4f1d80-749e-4eef-b2da-428e234d2082 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:59:04.778096 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-7f4f1d80-749e-4eef-b2da-428e234d2082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:59:04.872126 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 725/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 18:59:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:59:04.910229 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac19eb86-9d50-4f22-85e7-fc2b82a87dd1 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:59:04.911821 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-ac19eb86-9d50-4f22-85e7-fc2b82a87dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:59:05.013356 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac19eb86-9d50-4f22-85e7-fc2b82a87dd1 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:59:05.061363 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:59:05.087003 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99247560-ed9f-4149-b882-b343a8b04cd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703f0431d017405d942539de93a565b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:59:05.087615 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99247560-ed9f-4149-b882-b343a8b04cd6 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:59:05.087925 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99247560-ed9f-4149-b882-b343a8b04cd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:59:05.088200 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99247560-ed9f-4149-b882-b343a8b04cd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:59:05.089814 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-99247560-ed9f-4149-b882-b343a8b04cd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:59:05.198044 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99247560-ed9f-4149-b882-b343a8b04cd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:59:05.199479 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99247560-ed9f-4149-b882-b343a8b04cd6 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:59:05.217481 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 730/1455] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 18:59:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:59:07.252298 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58041730-9cfa-444c-a2ad-c6ca7e174bc0 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:59:07.252831 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58041730-9cfa-444c-a2ad-c6ca7e174bc0 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:59:07.252831 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58041730-9cfa-444c-a2ad-c6ca7e174bc0 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:59:07.254187 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 726/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 18:59:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:59:07.260000 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c8e8f-bb04-41a3-be33-392d5e600172 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:59:07.260444 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c8e8f-bb04-41a3-be33-392d5e600172 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:59:07.260552 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c8e8f-bb04-41a3-be33-392d5e600172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:59:07.324959 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-fb8c8e8f-bb04-41a3-be33-392d5e600172 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:59:07.326085 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-fb8c8e8f-bb04-41a3-be33-392d5e600172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:59:07.357063 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:59:07.426552 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 731/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 18:59:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:59:07.464012 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58041730-9cfa-444c-a2ad-c6ca7e174bc0 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:59:07.465534 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-58041730-9cfa-444c-a2ad-c6ca7e174bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:59:07.568640 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58041730-9cfa-444c-a2ad-c6ca7e174bc0 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:59:07.596550 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:59:07.641962 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5126ce51-404b-4537-b79f-9a149ed17a8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703f0431d017405d942539de93a565b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:59:07.642569 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126ce51-404b-4537-b79f-9a149ed17a8b service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:59:07.642845 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126ce51-404b-4537-b79f-9a149ed17a8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:59:07.643114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126ce51-404b-4537-b79f-9a149ed17a8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:59:07.644767 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-5126ce51-404b-4537-b79f-9a149ed17a8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:59:07.749742 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5126ce51-404b-4537-b79f-9a149ed17a8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:59:07.751189 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5126ce51-404b-4537-b79f-9a149ed17a8b service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:59:07.768839 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 727/1458] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 18:59:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:59:09.873359 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f05f2f-2006-4c05-8afa-674699a344be None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:59:09.873895 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f05f2f-2006-4c05-8afa-674699a344be None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:59:09.873895 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f05f2f-2006-4c05-8afa-674699a344be None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:59:09.875172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 732/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 18:59:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:59:09.880669 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e7fbd7-01ed-4e32-af9c-54c38051929e None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:59:09.881118 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e7fbd7-01ed-4e32-af9c-54c38051929e None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:59:09.881340 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e7fbd7-01ed-4e32-af9c-54c38051929e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:59:09.950380 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-43e7fbd7-01ed-4e32-af9c-54c38051929e None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:59:09.951596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-43e7fbd7-01ed-4e32-af9c-54c38051929e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:59:09.959828 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:59:10.048871 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 728/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 18:59:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:59:10.086851 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f05f2f-2006-4c05-8afa-674699a344be None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:59:10.088426 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-25f05f2f-2006-4c05-8afa-674699a344be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:59:10.193103 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f05f2f-2006-4c05-8afa-674699a344be None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:59:10.246878 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:59:10.266317 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad20541-2e3b-4b0f-8701-30cb715ab2ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703f0431d017405d942539de93a565b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:59:10.266930 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad20541-2e3b-4b0f-8701-30cb715ab2ec service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:59:10.267207 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad20541-2e3b-4b0f-8701-30cb715ab2ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:59:10.267476 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad20541-2e3b-4b0f-8701-30cb715ab2ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:59:10.269167 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-7ad20541-2e3b-4b0f-8701-30cb715ab2ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:59:10.375369 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad20541-2e3b-4b0f-8701-30cb715ab2ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:59:10.376808 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad20541-2e3b-4b0f-8701-30cb715ab2ec service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:59:10.395352 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 733/1461] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 18:59:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:59:12.463744 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae2afa-1cce-480f-8811-e66422fba6af None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:59:12.464290 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae2afa-1cce-480f-8811-e66422fba6af None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:59:12.464290 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae2afa-1cce-480f-8811-e66422fba6af None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:59:12.465637 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 729/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 18:59:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:59:12.470924 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67247f19-2969-4e93-b396-c05aa3c62fe1 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:59:12.471385 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67247f19-2969-4e93-b396-c05aa3c62fe1 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:59:12.471494 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67247f19-2969-4e93-b396-c05aa3c62fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:59:12.537144 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-67247f19-2969-4e93-b396-c05aa3c62fe1 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:59:12.538350 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-67247f19-2969-4e93-b396-c05aa3c62fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:59:12.577008 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:59:12.635363 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 734/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 18:59:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:59:12.672447 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae2afa-1cce-480f-8811-e66422fba6af None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:59:12.673965 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-deae2afa-1cce-480f-8811-e66422fba6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:59:12.774839 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae2afa-1cce-480f-8811-e66422fba6af None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:59:12.810571 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:59:12.852228 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b04beda-28e2-47ff-abed-6ec5647ef016 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703f0431d017405d942539de93a565b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:59:12.852228 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04beda-28e2-47ff-abed-6ec5647ef016 service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:59:12.852594 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04beda-28e2-47ff-abed-6ec5647ef016 service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:59:12.852760 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04beda-28e2-47ff-abed-6ec5647ef016 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:59:12.854398 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-1b04beda-28e2-47ff-abed-6ec5647ef016 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:59:12.964281 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b04beda-28e2-47ff-abed-6ec5647ef016 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:59:12.965718 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b04beda-28e2-47ff-abed-6ec5647ef016 service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:59:12.984118 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 730/1464] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 18:59:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:59:15.080813 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f900d36-e0b6-4f2e-8177-b3115239e5fc None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:59:15.081227 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f900d36-e0b6-4f2e-8177-b3115239e5fc None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:59:15.081368 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f900d36-e0b6-4f2e-8177-b3115239e5fc None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:59:15.082728 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 735/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 18:59:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:59:15.088660 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b9be7-9186-429e-a603-b62627d5463f None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:59:15.089095 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b9be7-9186-429e-a603-b62627d5463f None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:59:15.089204 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b9be7-9186-429e-a603-b62627d5463f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:59:15.153145 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-c26b9be7-9186-429e-a603-b62627d5463f None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:59:15.154344 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-c26b9be7-9186-429e-a603-b62627d5463f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:59:15.171771 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:59:15.250550 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 731/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 18:59:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:59:15.286955 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f900d36-e0b6-4f2e-8177-b3115239e5fc None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:59:15.288556 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-1f900d36-e0b6-4f2e-8177-b3115239e5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:59:15.391489 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f900d36-e0b6-4f2e-8177-b3115239e5fc None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:59:15.455737 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:59:15.463254 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfa4fa6-c993-465f-b137-0abcd03c0917 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703f0431d017405d942539de93a565b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:59:15.463891 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa4fa6-c993-465f-b137-0abcd03c0917 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:59:15.464167 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa4fa6-c993-465f-b137-0abcd03c0917 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:59:15.464437 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa4fa6-c993-465f-b137-0abcd03c0917 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:59:15.466044 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-5cfa4fa6-c993-465f-b137-0abcd03c0917 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:59:15.573471 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfa4fa6-c993-465f-b137-0abcd03c0917 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:59:15.574891 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfa4fa6-c993-465f-b137-0abcd03c0917 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:59:15.592359 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 736/1467] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 18:59:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:59:17.642079 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f6f44-9a60-48fd-a4bc-3c97a9eaf90a None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:59:17.642655 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f6f44-9a60-48fd-a4bc-3c97a9eaf90a None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:59:17.642655 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5f6f44-9a60-48fd-a4bc-3c97a9eaf90a None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:59:17.644016 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 732/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 18:59:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:59:17.649916 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801a11e-32ab-45d5-a454-05095615619b None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:59:17.650361 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801a11e-32ab-45d5-a454-05095615619b None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:59:17.650467 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801a11e-32ab-45d5-a454-05095615619b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:59:17.729244 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-b801a11e-32ab-45d5-a454-05095615619b None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:59:17.730452 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-b801a11e-32ab-45d5-a454-05095615619b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:59:17.777950 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:59:17.826917 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 737/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 18:59:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:59:17.863634 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f6f44-9a60-48fd-a4bc-3c97a9eaf90a None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:59:17.865225 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-9d5f6f44-9a60-48fd-a4bc-3c97a9eaf90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:59:17.966725 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5f6f44-9a60-48fd-a4bc-3c97a9eaf90a None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:59:18.025954 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:59:18.052782 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f09b9-d837-4dff-8921-d805882e4f81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703f0431d017405d942539de93a565b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:59:18.053398 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f09b9-d837-4dff-8921-d805882e4f81 service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:59:18.053679 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f09b9-d837-4dff-8921-d805882e4f81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:59:18.053952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f09b9-d837-4dff-8921-d805882e4f81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:59:18.056231 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-8d6f09b9-d837-4dff-8921-d805882e4f81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:59:18.161207 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f09b9-d837-4dff-8921-d805882e4f81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:59:18.162557 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f09b9-d837-4dff-8921-d805882e4f81 service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:59:18.181176 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 733/1470] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 18:59:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:59:27.825080 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=22 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:59:28.178284 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=66 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:59:37.708252 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316cd35-2b20-4aa6-b758-6042dd2dc255 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:59:37.708804 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316cd35-2b20-4aa6-b758-6042dd2dc255 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:59:37.708804 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316cd35-2b20-4aa6-b758-6042dd2dc255 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:59:37.710186 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 738/1471] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:59:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:59:37.715277 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60349c6-722b-44cf-a57e-8725f1323583 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:59:37.715759 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60349c6-722b-44cf-a57e-8725f1323583 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:59:37.715881 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60349c6-722b-44cf-a57e-8725f1323583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:59:37.780640 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-e60349c6-722b-44cf-a57e-8725f1323583 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:59:37.781826 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-e60349c6-722b-44cf-a57e-8725f1323583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:59:37.884955 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 734/1472] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:59:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:59:37.966422 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ba9e6-f45c-4b41-a6ac-b1518a4481f2 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:59:37.966780 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ba9e6-f45c-4b41-a6ac-b1518a4481f2 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:59:37.967148 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ba9e6-f45c-4b41-a6ac-b1518a4481f2 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:59:37.968602 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 739/1473] 10.222.0.20 () {54 vars in 966 bytes} [Wed Jul 27 18:59:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:59:37.973599 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eeab06-2c6f-42dc-af33-e6c828abe8e2 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:59:37.973886 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eeab06-2c6f-42dc-af33-e6c828abe8e2 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:59:37.974159 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eeab06-2c6f-42dc-af33-e6c828abe8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:59:38.048336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-01eeab06-2c6f-42dc-af33-e6c828abe8e2 None None] MFA Rules not processed for user `6c4b9109e80b4ae19a7c31de1cd9d2b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:59:38.049560 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-01eeab06-2c6f-42dc-af33-e6c828abe8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:59:38.069336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:59:38.124459 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 735/1474] 10.222.0.20 () {58 vars in 1063 bytes} [Wed Jul 27 18:59:37 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:59:38.132617 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6ba9e6-f45c-4b41-a6ac-b1518a4481f2 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:59:38.134117 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-5e6ba9e6-f45c-4b41-a6ac-b1518a4481f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:59:38.240401 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6ba9e6-f45c-4b41-a6ac-b1518a4481f2 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:59:38.313536 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc5929-2403-402c-8fb4-aa3097cb7f2e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c4b9109e80b4ae19a7c31de1cd9d2b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:59:38.314150 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc5929-2403-402c-8fb4-aa3097cb7f2e service glance] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:59:38.314435 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc5929-2403-402c-8fb4-aa3097cb7f2e service glance] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:59:38.314710 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc5929-2403-402c-8fb4-aa3097cb7f2e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:59:38.316372 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-17fc5929-2403-402c-8fb4-aa3097cb7f2e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:59:38.488482 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:59:38.543810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fc5929-2403-402c-8fb4-aa3097cb7f2e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:59:38.545231 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fc5929-2403-402c-8fb4-aa3097cb7f2e service glance] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:59:38.563369 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 740/1475] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 18:59:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:59:40.646354 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb389e-904b-4bcc-b680-f555b482e97a None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:59:40.646921 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb389e-904b-4bcc-b680-f555b482e97a None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:59:40.646921 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb389e-904b-4bcc-b680-f555b482e97a None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:59:40.648318 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 736/1476] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:59:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:59:40.653455 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d49a3-6484-4193-a311-a118eccb10d8 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:59:40.653897 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d49a3-6484-4193-a311-a118eccb10d8 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:59:40.654001 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d49a3-6484-4193-a311-a118eccb10d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:59:40.720318 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-aa9d49a3-6484-4193-a311-a118eccb10d8 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:59:40.721510 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-aa9d49a3-6484-4193-a311-a118eccb10d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:59:40.816563 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 741/1477] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:59:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:59:40.839436 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb389e-904b-4bcc-b680-f555b482e97a None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:59:40.841110 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-4dbb389e-904b-4bcc-b680-f555b482e97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:59:40.964534 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb389e-904b-4bcc-b680-f555b482e97a None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:59:41.011701 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:59:41.055924 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571770cd-b947-45fb-9377-cf8df29843d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6643b58dd5014772a6237180b96549c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:59:41.056521 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571770cd-b947-45fb-9377-cf8df29843d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:59:41.056793 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571770cd-b947-45fb-9377-cf8df29843d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:59:41.057058 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571770cd-b947-45fb-9377-cf8df29843d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:59:41.057737 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571770cd-b947-45fb-9377-cf8df29843d5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:59:41.059431 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: WARNING py.warnings [None req-571770cd-b947-45fb-9377-cf8df29843d5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 18:59:41.059431 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: warnings.warn(msg) Jul 27 18:59:41.059431 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: Jul 27 18:59:41.060582 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571770cd-b947-45fb-9377-cf8df29843d5 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:59:41.079408 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 737/1478] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 27 18:59:40 2022] GET /identity/v3/projects => generated 2553 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:59:43.128402 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a289945-4478-4a4b-b22a-b3b09df9831c None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:59:43.128911 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a289945-4478-4a4b-b22a-b3b09df9831c None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:59:43.129017 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a289945-4478-4a4b-b22a-b3b09df9831c None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:59:43.130294 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 742/1479] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:59:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:59:43.135494 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9d6a1-fad6-45be-b4c9-acc9c10b2af1 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:59:43.135960 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9d6a1-fad6-45be-b4c9-acc9c10b2af1 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:59:43.136081 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9d6a1-fad6-45be-b4c9-acc9c10b2af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:59:43.200178 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-cac9d6a1-fad6-45be-b4c9-acc9c10b2af1 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:59:43.201385 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-cac9d6a1-fad6-45be-b4c9-acc9c10b2af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:59:43.295799 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 738/1480] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:59:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:59:43.339050 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a289945-4478-4a4b-b22a-b3b09df9831c None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:59:43.340688 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-8a289945-4478-4a4b-b22a-b3b09df9831c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:59:43.350533 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:59:43.483512 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a289945-4478-4a4b-b22a-b3b09df9831c None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:59:43.565043 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:59:43.596518 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32ed1e2-c612-42d5-b2f4-174f945bff6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17fbef9db7734283aaad4962ee160171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:59:43.597121 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ed1e2-c612-42d5-b2f4-174f945bff6c service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:59:43.597393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ed1e2-c612-42d5-b2f4-174f945bff6c service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:59:43.597657 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ed1e2-c612-42d5-b2f4-174f945bff6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:59:43.599251 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-f32ed1e2-c612-42d5-b2f4-174f945bff6c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:59:43.687449 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32ed1e2-c612-42d5-b2f4-174f945bff6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:59:43.689046 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32ed1e2-c612-42d5-b2f4-174f945bff6c service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:59:43.706862 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 743/1481] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 18:59:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:59:45.878090 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445b5be-fc77-4926-8fe4-5201fee4bc08 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:59:45.878621 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445b5be-fc77-4926-8fe4-5201fee4bc08 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:59:45.878621 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445b5be-fc77-4926-8fe4-5201fee4bc08 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:59:45.879932 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 739/1482] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:59:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:59:45.885676 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec53018f-adf1-445a-a3cc-d9fa5c3aaef8 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:59:45.886090 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec53018f-adf1-445a-a3cc-d9fa5c3aaef8 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:59:45.886230 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec53018f-adf1-445a-a3cc-d9fa5c3aaef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:59:45.951524 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-ec53018f-adf1-445a-a3cc-d9fa5c3aaef8 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:59:45.952753 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-ec53018f-adf1-445a-a3cc-d9fa5c3aaef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:59:45.998000 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:59:46.053669 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 744/1483] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:59:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:59:46.091116 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b445b5be-fc77-4926-8fe4-5201fee4bc08 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:59:46.092665 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-b445b5be-fc77-4926-8fe4-5201fee4bc08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:59:46.115237 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:59:46.192882 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b445b5be-fc77-4926-8fe4-5201fee4bc08 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:59:46.263350 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e066eb51-ae85-49c1-b1cb-19854f3034a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703f0431d017405d942539de93a565b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:59:46.263983 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066eb51-ae85-49c1-b1cb-19854f3034a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:59:46.264267 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066eb51-ae85-49c1-b1cb-19854f3034a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:59:46.264538 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066eb51-ae85-49c1-b1cb-19854f3034a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:59:46.266152 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-e066eb51-ae85-49c1-b1cb-19854f3034a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:59:46.338633 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:59:46.372919 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e066eb51-ae85-49c1-b1cb-19854f3034a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:59:46.374345 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e066eb51-ae85-49c1-b1cb-19854f3034a5 service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:59:46.394327 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 740/1484] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 18:59:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:59:48.461840 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c5616-5450-466e-a253-ee53039e1ae4 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:59:48.462540 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c5616-5450-466e-a253-ee53039e1ae4 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:59:48.462540 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c5616-5450-466e-a253-ee53039e1ae4 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:59:48.463909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 745/1485] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:59:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:59:48.468994 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201529a7-0375-4248-ae99-3e5a9c176f24 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:59:48.469451 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201529a7-0375-4248-ae99-3e5a9c176f24 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:59:48.469559 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201529a7-0375-4248-ae99-3e5a9c176f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:59:48.533602 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-201529a7-0375-4248-ae99-3e5a9c176f24 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:59:48.534794 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-201529a7-0375-4248-ae99-3e5a9c176f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:59:48.629201 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 741/1486] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:59:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:59:48.668061 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c5616-5450-466e-a253-ee53039e1ae4 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:59:48.669569 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-1e0c5616-5450-466e-a253-ee53039e1ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:59:48.781970 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c5616-5450-466e-a253-ee53039e1ae4 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:59:48.853824 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:59:48.855827 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2e06e-9941-45b2-8421-b26eacc5b73c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703f0431d017405d942539de93a565b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:59:48.856523 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2e06e-9941-45b2-8421-b26eacc5b73c service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:59:48.857049 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2e06e-9941-45b2-8421-b26eacc5b73c service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:59:48.857363 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2e06e-9941-45b2-8421-b26eacc5b73c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:59:48.859919 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-67d2e06e-9941-45b2-8421-b26eacc5b73c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:59:48.968726 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d2e06e-9941-45b2-8421-b26eacc5b73c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:59:48.970142 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d2e06e-9941-45b2-8421-b26eacc5b73c service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:59:48.988465 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 746/1487] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 18:59:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:59:51.278377 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f3f42-e096-4f1a-9184-37f7d04bfaf9 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:59:51.278933 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f3f42-e096-4f1a-9184-37f7d04bfaf9 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:59:51.278933 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f3f42-e096-4f1a-9184-37f7d04bfaf9 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:59:51.280320 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 742/1488] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:59:51.285722 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe8af16-490c-407f-9d82-07c36b5dc3d7 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:59:51.286134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe8af16-490c-407f-9d82-07c36b5dc3d7 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:59:51.286280 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe8af16-490c-407f-9d82-07c36b5dc3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:59:51.351148 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-4fe8af16-490c-407f-9d82-07c36b5dc3d7 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:59:51.352301 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-4fe8af16-490c-407f-9d82-07c36b5dc3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:59:51.404840 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:59:51.448243 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 747/1489] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:59:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:59:51.488399 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4f3f42-e096-4f1a-9184-37f7d04bfaf9 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:59:51.489909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-1f4f3f42-e096-4f1a-9184-37f7d04bfaf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:59:51.525200 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:59:51.593606 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4f3f42-e096-4f1a-9184-37f7d04bfaf9 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:59:51.664685 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256cc704-2bee-4b43-9ac2-4b6085b5439f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703f0431d017405d942539de93a565b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:59:51.665297 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256cc704-2bee-4b43-9ac2-4b6085b5439f service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:59:51.665580 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256cc704-2bee-4b43-9ac2-4b6085b5439f service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:59:51.665854 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256cc704-2bee-4b43-9ac2-4b6085b5439f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:59:51.667507 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-256cc704-2bee-4b43-9ac2-4b6085b5439f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:59:51.745545 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:59:51.775430 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256cc704-2bee-4b43-9ac2-4b6085b5439f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:59:51.776900 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256cc704-2bee-4b43-9ac2-4b6085b5439f service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:59:51.794722 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 743/1490] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 18:59:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:59:53.987323 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6258c-9545-472b-9466-5aa5f0c7566a None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:59:53.987920 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6258c-9545-472b-9466-5aa5f0c7566a None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:59:53.987920 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6258c-9545-472b-9466-5aa5f0c7566a None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:59:53.989224 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 748/1491] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 27 18:59:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:59:53.994485 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d903a-2d23-4d80-8faf-2cd47abbfefa None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:59:53.994945 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d903a-2d23-4d80-8faf-2cd47abbfefa None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:59:53.995067 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d903a-2d23-4d80-8faf-2cd47abbfefa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:59:54.060148 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-548d903a-2d23-4d80-8faf-2cd47abbfefa None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:59:54.061503 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-548d903a-2d23-4d80-8faf-2cd47abbfefa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:59:54.156385 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 744/1492] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 27 18:59:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:59:54.195733 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b6258c-9545-472b-9466-5aa5f0c7566a None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:59:54.197285 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-c2b6258c-9545-472b-9466-5aa5f0c7566a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:59:54.299509 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b6258c-9545-472b-9466-5aa5f0c7566a None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:59:54.372223 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0fc9c-88e0-4bf7-b4c9-a8e8b53de5fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703f0431d017405d942539de93a565b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:59:54.372826 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0fc9c-88e0-4bf7-b4c9-a8e8b53de5fd service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:59:54.373102 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0fc9c-88e0-4bf7-b4c9-a8e8b53de5fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:59:54.373371 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0fc9c-88e0-4bf7-b4c9-a8e8b53de5fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:59:54.374977 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-e7c0fc9c-88e0-4bf7-b4c9-a8e8b53de5fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:59:54.384260 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:59:54.482120 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c0fc9c-88e0-4bf7-b4c9-a8e8b53de5fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:59:54.483534 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c0fc9c-88e0-4bf7-b4c9-a8e8b53de5fd service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:59:54.503334 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 749/1493] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 18:59:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:00:04.154532 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=82 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:00:04.501092 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=50 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:01:28.021596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af85157-9be6-415d-b05c-1e402d50005f None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:01:28.022190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af85157-9be6-415d-b05c-1e402d50005f None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:01:28.022190 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af85157-9be6-415d-b05c-1e402d50005f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:01:28.094812 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-0af85157-9be6-415d-b05c-1e402d50005f None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:01:28.096039 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-0af85157-9be6-415d-b05c-1e402d50005f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:01:28.190005 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 745/1494] 10.222.0.20 () {58 vars in 958 bytes} [Wed Jul 27 19:01:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:01:28.198204 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28959fe7-7f9e-4ef3-abc7-19fa3bbe02de None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:01:28.198713 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28959fe7-7f9e-4ef3-abc7-19fa3bbe02de None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:01:28.198819 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28959fe7-7f9e-4ef3-abc7-19fa3bbe02de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:01:28.279758 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-28959fe7-7f9e-4ef3-abc7-19fa3bbe02de None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:01:28.280919 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-28959fe7-7f9e-4ef3-abc7-19fa3bbe02de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:01:28.374862 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 750/1495] 10.222.0.20 () {58 vars in 958 bytes} [Wed Jul 27 19:01:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:01:28.380050 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af85157-9be6-415d-b05c-1e402d50005f None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:01:28.381257 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-0af85157-9be6-415d-b05c-1e402d50005f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:01:28.392532 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af85157-9be6-415d-b05c-1e402d50005f None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:01:28.452451 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:01:28.485196 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ff5b4-e283-4236-baf2-385f7b9337f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6643b58dd5014772a6237180b96549c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:01:28.486059 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ff5b4-e283-4236-baf2-385f7b9337f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:01:28.486331 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ff5b4-e283-4236-baf2-385f7b9337f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:01:28.486590 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ff5b4-e283-4236-baf2-385f7b9337f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:01:28.487268 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3ff5b4-e283-4236-baf2-385f7b9337f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:01:28.487562 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3ff5b4-e283-4236-baf2-385f7b9337f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:01:28.489094 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: WARNING py.warnings [None req-0a3ff5b4-e283-4236-baf2-385f7b9337f6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 19:01:28.489094 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: warnings.warn(msg) Jul 27 19:01:28.489094 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: Jul 27 19:01:28.489957 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3ff5b4-e283-4236-baf2-385f7b9337f6 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:01:28.500732 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 746/1496] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Jul 27 19:01:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:01:28.509497 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28959fe7-7f9e-4ef3-abc7-19fa3bbe02de None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:01:28.518407 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28959fe7-7f9e-4ef3-abc7-19fa3bbe02de None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:01:28.579326 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:01:28.612194 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b0295d-fd89-49b2-bb07-0b985f7f4a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6643b58dd5014772a6237180b96549c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:01:28.612809 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0295d-fd89-49b2-bb07-0b985f7f4a8e admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:01:28.613076 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0295d-fd89-49b2-bb07-0b985f7f4a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:01:28.613839 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0295d-fd89-49b2-bb07-0b985f7f4a8e admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:01:28.614493 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b0295d-fd89-49b2-bb07-0b985f7f4a8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:01:28.616247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: WARNING py.warnings [None req-a1b0295d-fd89-49b2-bb07-0b985f7f4a8e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 19:01:28.616247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: warnings.warn(msg) Jul 27 19:01:28.616247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: Jul 27 19:01:28.617433 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b0295d-fd89-49b2-bb07-0b985f7f4a8e admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:01:28.670468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 751/1497] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Jul 27 19:01:28 2022] POST /identity/v3/projects => generated 377 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 19:01:28.674628 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ff5b4-e283-4236-baf2-385f7b9337f6 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:01:28.676696 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-0a3ff5b4-e283-4236-baf2-385f7b9337f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:01:28.709408 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ff5b4-e283-4236-baf2-385f7b9337f6 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:01:28.803124 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8bbbb1-f90a-4644-a50d-95b1aac1d6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6643b58dd5014772a6237180b96549c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:01:28.803652 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8bbbb1-f90a-4644-a50d-95b1aac1d6e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:01:28.803960 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8bbbb1-f90a-4644-a50d-95b1aac1d6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:01:28.804230 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8bbbb1-f90a-4644-a50d-95b1aac1d6e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:01:28.804895 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8bbbb1-f90a-4644-a50d-95b1aac1d6e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:01:28.805897 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: WARNING py.warnings [None req-3c8bbbb1-f90a-4644-a50d-95b1aac1d6e9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 19:01:28.805897 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: warnings.warn(msg) Jul 27 19:01:28.805897 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: Jul 27 19:01:28.807088 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8bbbb1-f90a-4644-a50d-95b1aac1d6e9 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:01:28.853962 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 747/1498] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Jul 27 19:01:28 2022] POST /identity/v3/users => generated 289 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 19:01:28.858088 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b0295d-fd89-49b2-bb07-0b985f7f4a8e admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:01:28.859716 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a1b0295d-fd89-49b2-bb07-0b985f7f4a8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:01:28.923298 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b0295d-fd89-49b2-bb07-0b985f7f4a8e admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:01:29.008787 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:01:29.020950 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0111068a-a172-4414-9729-4e188271aa88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6643b58dd5014772a6237180b96549c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:01:29.021567 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111068a-a172-4414-9729-4e188271aa88 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:01:29.021874 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111068a-a172-4414-9729-4e188271aa88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:01:29.022147 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111068a-a172-4414-9729-4e188271aa88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:01:29.022834 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0111068a-a172-4414-9729-4e188271aa88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:01:29.023871 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: WARNING py.warnings [None req-0111068a-a172-4414-9729-4e188271aa88 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 19:01:29.023871 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: warnings.warn(msg) Jul 27 19:01:29.023871 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: Jul 27 19:01:29.024742 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0111068a-a172-4414-9729-4e188271aa88 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:01:29.037454 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 752/1499] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Jul 27 19:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 19:01:29.041489 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8bbbb1-f90a-4644-a50d-95b1aac1d6e9 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:01:29.043001 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-3c8bbbb1-f90a-4644-a50d-95b1aac1d6e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:01:29.054849 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8bbbb1-f90a-4644-a50d-95b1aac1d6e9 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:01:29.079639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:01:29.149339 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f763df9-4766-48d6-a23a-4c54cce0f835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6643b58dd5014772a6237180b96549c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:01:29.149958 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f763df9-4766-48d6-a23a-4c54cce0f835 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:01:29.150240 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f763df9-4766-48d6-a23a-4c54cce0f835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:01:29.150512 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f763df9-4766-48d6-a23a-4c54cce0f835 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:01:29.151199 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f763df9-4766-48d6-a23a-4c54cce0f835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:01:29.152258 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: WARNING py.warnings [None req-3f763df9-4766-48d6-a23a-4c54cce0f835 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 19:01:29.152258 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: warnings.warn(msg) Jul 27 19:01:29.152258 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: Jul 27 19:01:29.153099 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f763df9-4766-48d6-a23a-4c54cce0f835 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:01:29.166068 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 748/1500] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Jul 27 19:01:29 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 19:01:29.170287 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0111068a-a172-4414-9729-4e188271aa88 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:01:29.171817 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-0111068a-a172-4414-9729-4e188271aa88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:01:29.203504 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0111068a-a172-4414-9729-4e188271aa88 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:01:29.296202 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb33a9-3224-40c4-8b3b-65ba291d9a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6643b58dd5014772a6237180b96549c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:01:29.296886 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb33a9-3224-40c4-8b3b-65ba291d9a0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:01:29.297166 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb33a9-3224-40c4-8b3b-65ba291d9a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:01:29.297438 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb33a9-3224-40c4-8b3b-65ba291d9a0e admin admin] PATH_INFO: `/v3/projects/260b658e25fe4aa9bedb517f5e428b76/users/96ec51bef7bb4bf5b42235fd846f4f80/roles/448ae448fe9a474ab1166ca18f7ac4d8` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:01:29.318744 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bb33a9-3224-40c4-8b3b-65ba291d9a0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=260b658e25fe4aa9bedb517f5e428b76, user_id=96ec51bef7bb4bf5b42235fd846f4f80, role_id=448ae448fe9a474ab1166ca18f7ac4d8)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:01:29.319722 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: WARNING py.warnings [None req-c6bb33a9-3224-40c4-8b3b-65ba291d9a0e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 19:01:29.319722 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: warnings.warn(msg) Jul 27 19:01:29.319722 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: Jul 27 19:01:29.321653 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bb33a9-3224-40c4-8b3b-65ba291d9a0e admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:01:29.346084 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 753/1501] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Jul 27 19:01:29 2022] PUT /identity/v3/projects/260b658e25fe4aa9bedb517f5e428b76/users/96ec51bef7bb4bf5b42235fd846f4f80/roles/448ae448fe9a474ab1166ca18f7ac4d8 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:01:29.358638 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26099764-4da3-498b-862c-55bbdca97e3c None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:01:29.358999 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26099764-4da3-498b-862c-55bbdca97e3c None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:01:29.359348 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26099764-4da3-498b-862c-55bbdca97e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:01:29.415166 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-26099764-4da3-498b-862c-55bbdca97e3c None None] MFA Rules not processed for user `96ec51bef7bb4bf5b42235fd846f4f80`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:01:29.416403 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-26099764-4da3-498b-862c-55bbdca97e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:01:29.491922 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 749/1502] 10.222.0.20 () {58 vars in 958 bytes} [Wed Jul 27 19:01:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:01:29.505487 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42912f-3ecf-4a85-a990-040d0bef79c1 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:01:29.505780 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42912f-3ecf-4a85-a990-040d0bef79c1 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:01:29.506057 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42912f-3ecf-4a85-a990-040d0bef79c1 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:01:29.507415 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 754/1503] 10.222.0.20 () {54 vars in 964 bytes} [Wed Jul 27 19:01:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:01:29.512212 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9098be8-c6fd-4c96-859e-cae80aba4c7f None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:01:29.512501 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9098be8-c6fd-4c96-859e-cae80aba4c7f None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:01:29.512776 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9098be8-c6fd-4c96-859e-cae80aba4c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:01:29.544627 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:01:29.588671 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-a9098be8-c6fd-4c96-859e-cae80aba4c7f None None] MFA Rules not processed for user `d5525865e12c41fe8da761cd25c14e2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:01:29.589800 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-a9098be8-c6fd-4c96-859e-cae80aba4c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:01:29.663537 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 750/1504] 10.222.0.20 () {58 vars in 1061 bytes} [Wed Jul 27 19:01:29 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 19:01:29.672976 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d42912f-3ecf-4a85-a990-040d0bef79c1 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:01:29.675353 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-4d42912f-3ecf-4a85-a990-040d0bef79c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:01:29.726052 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:01:29.780909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d42912f-3ecf-4a85-a990-040d0bef79c1 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:01:29.852926 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c1fa6-2899-473e-a6a7-835555f75c26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5525865e12c41fe8da761cd25c14e2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:01:29.853454 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c1fa6-2899-473e-a6a7-835555f75c26 service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:01:29.853733 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c1fa6-2899-473e-a6a7-835555f75c26 service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:01:29.854003 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c1fa6-2899-473e-a6a7-835555f75c26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:01:29.855619 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-ba8c1fa6-2899-473e-a6a7-835555f75c26 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:01:29.952133 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8c1fa6-2899-473e-a6a7-835555f75c26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:01:29.953573 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8c1fa6-2899-473e-a6a7-835555f75c26 service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:01:29.957066 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:01:29.971756 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 755/1505] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 19:01:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 19:01:30.016838 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2304d-1def-491c-aa5f-a62670f58010 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:01:30.017128 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2304d-1def-491c-aa5f-a62670f58010 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:01:30.017406 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2304d-1def-491c-aa5f-a62670f58010 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:01:30.018724 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 751/1506] 10.222.0.20 () {52 vars in 830 bytes} [Wed Jul 27 19:01:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:01:30.026969 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c1fa6-2899-473e-a6a7-835555f75c26 service cinder] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:01:30.028257 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-ba8c1fa6-2899-473e-a6a7-835555f75c26 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:01:30.131407 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c1fa6-2899-473e-a6a7-835555f75c26 service cinder] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:01:30.222746 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba84616-c473-4a7a-bd4a-b4864e59ebf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6643b58dd5014772a6237180b96549c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:01:30.223660 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba84616-c473-4a7a-bd4a-b4864e59ebf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:01:30.223869 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba84616-c473-4a7a-bd4a-b4864e59ebf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:01:30.224065 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba84616-c473-4a7a-bd4a-b4864e59ebf1 admin admin] PATH_INFO: `/v3/users/96ec51bef7bb4bf5b42235fd846f4f80` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:01:30.238186 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba84616-c473-4a7a-bd4a-b4864e59ebf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96ec51bef7bb4bf5b42235fd846f4f80)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:01:30.239727 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: WARNING py.warnings [None req-5ba84616-c473-4a7a-bd4a-b4864e59ebf1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 19:01:30.239727 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: warnings.warn(msg) Jul 27 19:01:30.239727 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: Jul 27 19:01:30.241157 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba84616-c473-4a7a-bd4a-b4864e59ebf1 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:01:30.250594 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:01:30.305885 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-5ba84616-c473-4a7a-bd4a-b4864e59ebf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96ec51bef7bb4bf5b42235fd846f4f80'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:01:30.306424 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-5ba84616-c473-4a7a-bd4a-b4864e59ebf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96ec51bef7bb4bf5b42235fd846f4f80'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:01:30.315320 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-5ba84616-c473-4a7a-bd4a-b4864e59ebf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96ec51bef7bb4bf5b42235fd846f4f80'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:01:30.335402 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-5ba84616-c473-4a7a-bd4a-b4864e59ebf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96ec51bef7bb4bf5b42235fd846f4f80'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:01:30.353997 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-5ba84616-c473-4a7a-bd4a-b4864e59ebf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96ec51bef7bb4bf5b42235fd846f4f80'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:01:30.362881 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 756/1507] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Jul 27 19:01:30 2022] DELETE /identity/v3/users/96ec51bef7bb4bf5b42235fd846f4f80 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:01:30.368309 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff3b7e-b767-4c28-83b4-f7266c9b597b None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:01:30.368928 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff3b7e-b767-4c28-83b4-f7266c9b597b None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:01:30.368928 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff3b7e-b767-4c28-83b4-f7266c9b597b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:01:30.440773 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-92ff3b7e-b767-4c28-83b4-f7266c9b597b None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:01:30.442186 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-92ff3b7e-b767-4c28-83b4-f7266c9b597b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:01:30.515461 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:01:30.528322 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 752/1508] 10.222.0.20 () {58 vars in 958 bytes} [Wed Jul 27 19:01:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:01:30.538375 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba84616-c473-4a7a-bd4a-b4864e59ebf1 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:01:30.539602 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-5ba84616-c473-4a7a-bd4a-b4864e59ebf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:01:30.638272 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba84616-c473-4a7a-bd4a-b4864e59ebf1 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:01:30.694542 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:01:30.718665 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb799bf-0555-441e-9227-cac5a9e9a025 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703f0431d017405d942539de93a565b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:01:30.719289 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb799bf-0555-441e-9227-cac5a9e9a025 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:01:30.719570 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb799bf-0555-441e-9227-cac5a9e9a025 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:01:30.719878 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb799bf-0555-441e-9227-cac5a9e9a025 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:01:30.721526 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-6bb799bf-0555-441e-9227-cac5a9e9a025 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:01:30.835250 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb799bf-0555-441e-9227-cac5a9e9a025 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:01:30.836709 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb799bf-0555-441e-9227-cac5a9e9a025 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:01:30.854948 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 757/1509] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 19:01:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:01:31.205961 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff3b7e-b767-4c28-83b4-f7266c9b597b None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:01:31.207957 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-92ff3b7e-b767-4c28-83b4-f7266c9b597b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:01:31.219112 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff3b7e-b767-4c28-83b4-f7266c9b597b None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:01:31.315467 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc2f4b7-51b3-4451-98de-dc5addbe152c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6643b58dd5014772a6237180b96549c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:01:31.316132 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2f4b7-51b3-4451-98de-dc5addbe152c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:01:31.316947 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2f4b7-51b3-4451-98de-dc5addbe152c admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:01:31.317216 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2f4b7-51b3-4451-98de-dc5addbe152c admin admin] PATH_INFO: `/v3/projects/260b658e25fe4aa9bedb517f5e428b76` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:01:31.327117 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc2f4b7-51b3-4451-98de-dc5addbe152c admin admin] RBAC: Authorizing `identity:delete_project(project_id=260b658e25fe4aa9bedb517f5e428b76)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:01:31.328175 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: WARNING py.warnings [None req-fdc2f4b7-51b3-4451-98de-dc5addbe152c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 19:01:31.328175 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: warnings.warn(msg) Jul 27 19:01:31.328175 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: Jul 27 19:01:31.329365 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc2f4b7-51b3-4451-98de-dc5addbe152c admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:01:31.385782 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-fdc2f4b7-51b3-4451-98de-dc5addbe152c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '260b658e25fe4aa9bedb517f5e428b76', 'request_id': 'req-fdc2f4b7-51b3-4451-98de-dc5addbe152c'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:01:31.404252 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-fdc2f4b7-51b3-4451-98de-dc5addbe152c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '260b658e25fe4aa9bedb517f5e428b76', 'request_id': 'req-fdc2f4b7-51b3-4451-98de-dc5addbe152c'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:01:31.412853 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-fdc2f4b7-51b3-4451-98de-dc5addbe152c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '260b658e25fe4aa9bedb517f5e428b76', 'request_id': 'req-fdc2f4b7-51b3-4451-98de-dc5addbe152c'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:01:31.435431 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-fdc2f4b7-51b3-4451-98de-dc5addbe152c admin admin] The token cache is being invalidate because project 260b658e25fe4aa9bedb517f5e428b76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 19:01:31.435809 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-fdc2f4b7-51b3-4451-98de-dc5addbe152c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:01:31.436231 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-fdc2f4b7-51b3-4451-98de-dc5addbe152c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:01:31.437741 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 753/1510] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Jul 27 19:01:31 2022] DELETE /identity/v3/projects/260b658e25fe4aa9bedb517f5e428b76 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:01:40.852747 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=62 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:01:41.433506 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:02:48.440489 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e5ff7-b1b7-4965-a3ea-e9e3ce51ac91 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:02:48.441099 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e5ff7-b1b7-4965-a3ea-e9e3ce51ac91 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:02:48.441099 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e5ff7-b1b7-4965-a3ea-e9e3ce51ac91 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:02:48.442374 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 758/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 19:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 19:02:48.447086 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546ef47-07b8-4dc1-aaa1-276247d60974 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:02:48.447545 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546ef47-07b8-4dc1-aaa1-276247d60974 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:02:48.447645 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546ef47-07b8-4dc1-aaa1-276247d60974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:02:48.530162 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-0546ef47-07b8-4dc1-aaa1-276247d60974 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:02:48.531364 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-0546ef47-07b8-4dc1-aaa1-276247d60974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:02:48.631984 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 754/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 19:02:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:02:48.786393 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e5ff7-b1b7-4965-a3ea-e9e3ce51ac91 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:02:48.788478 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-c20e5ff7-b1b7-4965-a3ea-e9e3ce51ac91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:02:48.906063 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e5ff7-b1b7-4965-a3ea-e9e3ce51ac91 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:02:48.911447 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a02d98-80f5-4cc3-b576-9aa5b8cb9902 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17fbef9db7734283aaad4962ee160171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:02:48.912090 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a02d98-80f5-4cc3-b576-9aa5b8cb9902 service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:02:48.912369 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a02d98-80f5-4cc3-b576-9aa5b8cb9902 service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:02:48.912643 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a02d98-80f5-4cc3-b576-9aa5b8cb9902 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:02:48.920552 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a02d98-80f5-4cc3-b576-9aa5b8cb9902 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:02:48.922116 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a02d98-80f5-4cc3-b576-9aa5b8cb9902 service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:02:48.931377 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 759/1513] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 19:02:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:02:49.757088 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bca8e6-55d2-41eb-afdb-9468c9dbc823 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:02:49.757650 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bca8e6-55d2-41eb-afdb-9468c9dbc823 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:02:49.757650 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bca8e6-55d2-41eb-afdb-9468c9dbc823 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:02:49.759019 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 755/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 19:02:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:02:49.763889 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef8fe4-2da3-4de2-9742-829c8320922a None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:02:49.764330 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef8fe4-2da3-4de2-9742-829c8320922a None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:02:49.764442 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef8fe4-2da3-4de2-9742-829c8320922a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:02:49.784125 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-bcef8fe4-2da3-4de2-9742-829c8320922a None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:02:49.785231 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-bcef8fe4-2da3-4de2-9742-829c8320922a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:02:49.792922 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 760/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 19:02:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:02:49.944391 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bca8e6-55d2-41eb-afdb-9468c9dbc823 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:02:49.959091 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bca8e6-55d2-41eb-afdb-9468c9dbc823 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:02:49.964534 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5aaaca-31db-457d-9323-9706c0ee0ced service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17fbef9db7734283aaad4962ee160171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:02:49.965129 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5aaaca-31db-457d-9323-9706c0ee0ced service nova] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:02:49.965405 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5aaaca-31db-457d-9323-9706c0ee0ced service nova] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:02:49.965674 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5aaaca-31db-457d-9323-9706c0ee0ced service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:02:49.974252 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5aaaca-31db-457d-9323-9706c0ee0ced service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:02:49.975839 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5aaaca-31db-457d-9323-9706c0ee0ced service nova] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:02:49.984913 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 756/1516] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 19:02:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:02:52.981347 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1549382b-0733-4817-9dfd-3e6cec781d53 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:02:52.981933 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1549382b-0733-4817-9dfd-3e6cec781d53 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:02:52.981933 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1549382b-0733-4817-9dfd-3e6cec781d53 None None] PATH_INFO: `/v3` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:02:52.983157 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 761/1517] 10.222.0.45 () {54 vars in 925 bytes} [Wed Jul 27 19:02:52 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:02:52.989646 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9cb898-81c5-4993-a3d4-ae84fc0b0919 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:02:52.990070 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9cb898-81c5-4993-a3d4-ae84fc0b0919 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:02:52.990178 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9cb898-81c5-4993-a3d4-ae84fc0b0919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:02:53.046912 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-cc9cb898-81c5-4993-a3d4-ae84fc0b0919 None None] MFA Rules not processed for user `3b0382b170fb49e785a57bbb329d4b37`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:02:53.048174 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-cc9cb898-81c5-4993-a3d4-ae84fc0b0919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:02:53.064332 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:02:53.120181 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 757/1518] 10.222.0.45 () {58 vars in 1015 bytes} [Wed Jul 27 19:02:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:02:59.779300 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=56 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:03:01.205947 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbfcc27-b2e2-48af-9f28-f33ca159022e None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:03:01.206456 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbfcc27-b2e2-48af-9f28-f33ca159022e None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:03:01.206564 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbfcc27-b2e2-48af-9f28-f33ca159022e None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:03:01.207904 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 762/1519] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 19:03:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:03:01.212692 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6212adf-b81a-434a-b2d5-892e9fbef18b None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:03:01.213132 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6212adf-b81a-434a-b2d5-892e9fbef18b None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:03:01.213277 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6212adf-b81a-434a-b2d5-892e9fbef18b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:03:01.232880 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-c6212adf-b81a-434a-b2d5-892e9fbef18b None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:03:01.234074 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-c6212adf-b81a-434a-b2d5-892e9fbef18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:03:01.242359 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 758/1520] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 19:03:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:03:01.400889 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbfcc27-b2e2-48af-9f28-f33ca159022e None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:03:01.416016 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbfcc27-b2e2-48af-9f28-f33ca159022e None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:03:01.421439 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b91b0-5eae-4905-9366-624ae089237c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17fbef9db7734283aaad4962ee160171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:03:01.422037 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b91b0-5eae-4905-9366-624ae089237c service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:03:01.422910 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b91b0-5eae-4905-9366-624ae089237c service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:03:01.423193 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b91b0-5eae-4905-9366-624ae089237c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:03:01.431253 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90b91b0-5eae-4905-9366-624ae089237c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:03:01.432845 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90b91b0-5eae-4905-9366-624ae089237c service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:03:01.442178 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 763/1521] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 19:03:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 19:03:01.949607 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2703d1-f8dc-4956-88d3-38e8e1885eca None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:03:01.949896 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2703d1-f8dc-4956-88d3-38e8e1885eca None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:03:01.950180 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2703d1-f8dc-4956-88d3-38e8e1885eca None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:03:01.951551 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 759/1522] 10.222.0.20 () {54 vars in 961 bytes} [Wed Jul 27 19:03:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:03:01.956610 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb647a45-28f2-4e52-9f69-bb582229625b None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:03:01.956894 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb647a45-28f2-4e52-9f69-bb582229625b None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:03:01.957165 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb647a45-28f2-4e52-9f69-bb582229625b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:03:01.976261 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-cb647a45-28f2-4e52-9f69-bb582229625b None None] MFA Rules not processed for user `3b0382b170fb49e785a57bbb329d4b37`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:03:01.977595 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-cb647a45-28f2-4e52-9f69-bb582229625b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:03:01.987029 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 764/1523] 10.222.0.20 () {58 vars in 1058 bytes} [Wed Jul 27 19:03:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:03:01.994635 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2703d1-f8dc-4956-88d3-38e8e1885eca None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:03:02.008556 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2703d1-f8dc-4956-88d3-38e8e1885eca None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:03:02.013551 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e50f48-f660-4c8e-bd57-323bca2afaa7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b0382b170fb49e785a57bbb329d4b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:03:02.014157 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e50f48-f660-4c8e-bd57-323bca2afaa7 service placement] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:03:02.014437 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e50f48-f660-4c8e-bd57-323bca2afaa7 service placement] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:03:02.014711 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e50f48-f660-4c8e-bd57-323bca2afaa7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:03:02.022854 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e50f48-f660-4c8e-bd57-323bca2afaa7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:03:02.024443 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e50f48-f660-4c8e-bd57-323bca2afaa7 service placement] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:03:02.034307 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 760/1524] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 19:03:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:03:02.266538 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8453aa-3ed0-4add-9d28-fed8550469b9 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:03:02.267054 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8453aa-3ed0-4add-9d28-fed8550469b9 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:03:02.267054 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8453aa-3ed0-4add-9d28-fed8550469b9 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:03:02.268463 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 765/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 19:03:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:03:02.273513 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8edee8-622c-432b-b744-07877c9eee0d None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:03:02.273934 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8edee8-622c-432b-b744-07877c9eee0d None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:03:02.274056 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8edee8-622c-432b-b744-07877c9eee0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:03:02.293492 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-3f8edee8-622c-432b-b744-07877c9eee0d None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:03:02.294684 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-3f8edee8-622c-432b-b744-07877c9eee0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:03:02.303175 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 761/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 19:03:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 19:03:02.461362 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8453aa-3ed0-4add-9d28-fed8550469b9 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:03:02.476198 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8453aa-3ed0-4add-9d28-fed8550469b9 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:03:02.482552 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f16af10-d27c-45e9-be1e-d0a0a285f946 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17fbef9db7734283aaad4962ee160171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:03:02.483150 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f16af10-d27c-45e9-be1e-d0a0a285f946 service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:03:02.483433 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f16af10-d27c-45e9-be1e-d0a0a285f946 service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:03:02.483734 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f16af10-d27c-45e9-be1e-d0a0a285f946 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:03:02.492592 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f16af10-d27c-45e9-be1e-d0a0a285f946 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:03:02.494153 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f16af10-d27c-45e9-be1e-d0a0a285f946 service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:03:02.503459 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 766/1527] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 19:03:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:03:06.677822 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7747b-53c9-46e6-aabd-6922244051d1 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:03:06.678395 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7747b-53c9-46e6-aabd-6922244051d1 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:03:06.678395 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7747b-53c9-46e6-aabd-6922244051d1 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:03:06.679886 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 762/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 19:03:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:03:06.684893 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c8771-6cd5-4b55-a7ea-7ffbb9c904d1 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:03:06.685304 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c8771-6cd5-4b55-a7ea-7ffbb9c904d1 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:03:06.685453 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c8771-6cd5-4b55-a7ea-7ffbb9c904d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:03:06.705354 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-b15c8771-6cd5-4b55-a7ea-7ffbb9c904d1 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:03:06.706527 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-b15c8771-6cd5-4b55-a7ea-7ffbb9c904d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:03:06.714187 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 767/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 19:03:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:03:06.786601 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7747b-53c9-46e6-aabd-6922244051d1 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:03:06.788287 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-51f7747b-53c9-46e6-aabd-6922244051d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:03:06.865362 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7747b-53c9-46e6-aabd-6922244051d1 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:03:06.868928 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfbddfc-b5ca-461f-a8e9-93c44bc27888 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703f0431d017405d942539de93a565b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:03:06.869532 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfbddfc-b5ca-461f-a8e9-93c44bc27888 service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:03:06.869812 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfbddfc-b5ca-461f-a8e9-93c44bc27888 service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:03:06.870082 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfbddfc-b5ca-461f-a8e9-93c44bc27888 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:03:06.879267 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfbddfc-b5ca-461f-a8e9-93c44bc27888 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:03:06.880714 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfbddfc-b5ca-461f-a8e9-93c44bc27888 service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:03:06.889865 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 763/1530] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 19:03:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:03:08.846036 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08e006-3bfa-4d8c-8b04-6a2668a7d937 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:03:08.846616 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08e006-3bfa-4d8c-8b04-6a2668a7d937 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:03:08.846616 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08e006-3bfa-4d8c-8b04-6a2668a7d937 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:03:08.848564 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 768/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 19:03:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:03:08.853573 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8c2f7-bef6-4427-a14f-0fb8ebf640db None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:03:08.854023 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8c2f7-bef6-4427-a14f-0fb8ebf640db None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:03:08.854136 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8c2f7-bef6-4427-a14f-0fb8ebf640db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:03:08.874051 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-6cc8c2f7-bef6-4427-a14f-0fb8ebf640db None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:03:08.875919 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-6cc8c2f7-bef6-4427-a14f-0fb8ebf640db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:03:08.883728 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 764/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 19:03:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:03:08.919323 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a08e006-3bfa-4d8c-8b04-6a2668a7d937 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:03:08.930606 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a08e006-3bfa-4d8c-8b04-6a2668a7d937 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:03:08.934073 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c92622-c743-444d-bc0c-7a4b741432c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703f0431d017405d942539de93a565b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:03:08.934664 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c92622-c743-444d-bc0c-7a4b741432c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:03:08.934938 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c92622-c743-444d-bc0c-7a4b741432c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:03:08.935205 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c92622-c743-444d-bc0c-7a4b741432c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:03:08.943907 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c92622-c743-444d-bc0c-7a4b741432c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:03:08.945295 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c92622-c743-444d-bc0c-7a4b741432c7 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:03:08.954431 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 769/1533] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 19:03:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:03:12.459014 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a4c1a-86a5-487f-97a3-f439b754c273 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:03:12.459558 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a4c1a-86a5-487f-97a3-f439b754c273 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:03:12.459558 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a4c1a-86a5-487f-97a3-f439b754c273 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:03:12.460958 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 765/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 19:03:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:03:12.466047 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4a866-6cb1-4bd7-948e-6b24ab4dd07a None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:03:12.466453 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4a866-6cb1-4bd7-948e-6b24ab4dd07a None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:03:12.466599 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4a866-6cb1-4bd7-948e-6b24ab4dd07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:03:12.486149 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-a7b4a866-6cb1-4bd7-948e-6b24ab4dd07a None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:03:12.487324 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a7b4a866-6cb1-4bd7-948e-6b24ab4dd07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:03:12.494987 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 770/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 19:03:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:03:12.803463 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a4c1a-86a5-487f-97a3-f439b754c273 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:03:12.805187 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-ab9a4c1a-86a5-487f-97a3-f439b754c273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:03:12.869496 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:03:12.883285 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a4c1a-86a5-487f-97a3-f439b754c273 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:03:12.886843 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e3b18-004e-4d03-b5f8-d2a3cdcc9bbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5525865e12c41fe8da761cd25c14e2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:03:12.887453 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e3b18-004e-4d03-b5f8-d2a3cdcc9bbd service cinder] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:03:12.887770 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e3b18-004e-4d03-b5f8-d2a3cdcc9bbd service cinder] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:03:12.888047 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e3b18-004e-4d03-b5f8-d2a3cdcc9bbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:03:12.897465 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861e3b18-004e-4d03-b5f8-d2a3cdcc9bbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:03:12.898868 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861e3b18-004e-4d03-b5f8-d2a3cdcc9bbd service cinder] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:03:12.908093 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 766/1536] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 19:03:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 19:03:14.938612 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec02066-315a-4ce3-9320-63db00a32710 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:03:14.939140 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec02066-315a-4ce3-9320-63db00a32710 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:03:14.939140 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec02066-315a-4ce3-9320-63db00a32710 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:03:14.940539 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 771/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 19:03:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:03:14.945595 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940d00d-39c8-4d49-b384-1808d8565c92 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:03:14.946042 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940d00d-39c8-4d49-b384-1808d8565c92 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:03:14.946140 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940d00d-39c8-4d49-b384-1808d8565c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:03:14.965203 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-5940d00d-39c8-4d49-b384-1808d8565c92 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:03:14.966392 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-5940d00d-39c8-4d49-b384-1808d8565c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:03:14.974715 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 767/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 19:03:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:03:15.276126 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec02066-315a-4ce3-9320-63db00a32710 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:03:15.277823 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-7ec02066-315a-4ce3-9320-63db00a32710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:03:15.291368 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec02066-315a-4ce3-9320-63db00a32710 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:03:15.294903 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14312c0-83cd-4fd7-9417-ca90d0c2e215 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5525865e12c41fe8da761cd25c14e2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:03:15.295500 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14312c0-83cd-4fd7-9417-ca90d0c2e215 service cinder] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:03:15.295823 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14312c0-83cd-4fd7-9417-ca90d0c2e215 service cinder] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:03:15.296101 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14312c0-83cd-4fd7-9417-ca90d0c2e215 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:03:15.306035 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14312c0-83cd-4fd7-9417-ca90d0c2e215 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:03:15.307461 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14312c0-83cd-4fd7-9417-ca90d0c2e215 service cinder] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:03:15.329502 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 772/1539] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 19:03:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:03:24.960529 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=11 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:03:25.312932 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=33 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:04:37.337981 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9648a-66f6-4c77-8ef0-b1c82a502889 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:04:37.338602 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9648a-66f6-4c77-8ef0-b1c82a502889 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:04:37.338602 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9648a-66f6-4c77-8ef0-b1c82a502889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:04:37.351219 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ae184-77c5-47c1-9dcd-742ade3fbfde None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:04:37.351756 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ae184-77c5-47c1-9dcd-742ade3fbfde None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:04:37.351879 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ae184-77c5-47c1-9dcd-742ade3fbfde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:04:37.359573 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-9ef9648a-66f6-4c77-8ef0-b1c82a502889 None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:04:37.360789 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-9ef9648a-66f6-4c77-8ef0-b1c82a502889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:04:37.368525 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 768/1540] 10.222.0.20 () {58 vars in 958 bytes} [Wed Jul 27 19:04:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:04:37.371811 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-113ae184-77c5-47c1-9dcd-742ade3fbfde None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:04:37.373005 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-113ae184-77c5-47c1-9dcd-742ade3fbfde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:04:37.377237 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051f127-3ce6-4b87-a1a5-099d2c37095e None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:04:37.377523 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051f127-3ce6-4b87-a1a5-099d2c37095e None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:04:37.377796 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051f127-3ce6-4b87-a1a5-099d2c37095e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:04:37.381060 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 773/1541] 10.222.0.20 () {58 vars in 958 bytes} [Wed Jul 27 19:04:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 19:04:37.388795 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b244f0-943b-4a8a-8d9c-609e39f7afac None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:04:37.389080 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b244f0-943b-4a8a-8d9c-609e39f7afac None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:04:37.389356 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b244f0-943b-4a8a-8d9c-609e39f7afac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:04:37.396894 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-a051f127-3ce6-4b87-a1a5-099d2c37095e None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:04:37.398082 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-a051f127-3ce6-4b87-a1a5-099d2c37095e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:04:37.407977 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 769/1542] 10.222.0.20 () {58 vars in 958 bytes} [Wed Jul 27 19:04:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 19:04:37.410379 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-59b244f0-943b-4a8a-8d9c-609e39f7afac None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:04:37.411590 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-59b244f0-943b-4a8a-8d9c-609e39f7afac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:04:37.413040 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a051f127-3ce6-4b87-a1a5-099d2c37095e None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:04:37.420224 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 774/1543] 10.222.0.20 () {58 vars in 958 bytes} [Wed Jul 27 19:04:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 19:04:37.424132 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a051f127-3ce6-4b87-a1a5-099d2c37095e None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:04:37.425470 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b244f0-943b-4a8a-8d9c-609e39f7afac None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:04:37.428777 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82dad40-afe6-4395-a15c-353c74ed2ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6643b58dd5014772a6237180b96549c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:04:37.429376 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82dad40-afe6-4395-a15c-353c74ed2ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:04:37.429655 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82dad40-afe6-4395-a15c-353c74ed2ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:04:37.429931 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82dad40-afe6-4395-a15c-353c74ed2ac3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:04:37.430629 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82dad40-afe6-4395-a15c-353c74ed2ac3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80075) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:04:37.430919 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82dad40-afe6-4395-a15c-353c74ed2ac3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:04:37.432556 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82dad40-afe6-4395-a15c-353c74ed2ac3 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:04:37.434583 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b244f0-943b-4a8a-8d9c-609e39f7afac None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:04:37.439177 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2158c7eb-3ba7-4e0d-837e-512fa31a1378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6643b58dd5014772a6237180b96549c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:04:37.439805 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158c7eb-3ba7-4e0d-837e-512fa31a1378 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:04:37.440085 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158c7eb-3ba7-4e0d-837e-512fa31a1378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:04:37.440354 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158c7eb-3ba7-4e0d-837e-512fa31a1378 admin admin] PATH_INFO: `/v3/domains` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:04:37.441032 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2158c7eb-3ba7-4e0d-837e-512fa31a1378 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80076) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:04:37.441333 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2158c7eb-3ba7-4e0d-837e-512fa31a1378 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:04:37.442343 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: WARNING py.warnings [None req-2158c7eb-3ba7-4e0d-837e-512fa31a1378 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 19:04:37.442343 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: warnings.warn(msg) Jul 27 19:04:37.442343 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: Jul 27 19:04:37.443205 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2158c7eb-3ba7-4e0d-837e-512fa31a1378 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:04:37.445510 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 770/1544] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Jul 27 19:04:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:04:37.453455 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82dad40-afe6-4395-a15c-353c74ed2ac3 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:04:37.458869 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 775/1545] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Jul 27 19:04:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 19:04:37.464035 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82dad40-afe6-4395-a15c-353c74ed2ac3 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:04:37.467008 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2158c7eb-3ba7-4e0d-837e-512fa31a1378 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:04:37.469567 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4eaf63-82dc-43f3-af01-1bb1fb420937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6643b58dd5014772a6237180b96549c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:04:37.470196 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4eaf63-82dc-43f3-af01-1bb1fb420937 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:04:37.470480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4eaf63-82dc-43f3-af01-1bb1fb420937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:04:37.470755 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4eaf63-82dc-43f3-af01-1bb1fb420937 admin admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:04:37.471415 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4eaf63-82dc-43f3-af01-1bb1fb420937 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:04:37.472487 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: WARNING py.warnings [None req-bd4eaf63-82dc-43f3-af01-1bb1fb420937 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 19:04:37.472487 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: warnings.warn(msg) Jul 27 19:04:37.472487 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: Jul 27 19:04:37.473767 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4eaf63-82dc-43f3-af01-1bb1fb420937 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:04:37.476470 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2158c7eb-3ba7-4e0d-837e-512fa31a1378 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:04:37.481858 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b46699d-e82b-4613-9bb5-dd0a8a8bd02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6643b58dd5014772a6237180b96549c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:04:37.482461 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b46699d-e82b-4613-9bb5-dd0a8a8bd02e admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:04:37.482743 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b46699d-e82b-4613-9bb5-dd0a8a8bd02e admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:04:37.483017 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b46699d-e82b-4613-9bb5-dd0a8a8bd02e admin admin] PATH_INFO: `/v3/projects` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:04:37.483704 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b46699d-e82b-4613-9bb5-dd0a8a8bd02e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:04:37.485846 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b46699d-e82b-4613-9bb5-dd0a8a8bd02e admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:04:37.513690 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 771/1546] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Jul 27 19:04:37 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 19:04:37.518125 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4eaf63-82dc-43f3-af01-1bb1fb420937 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:04:37.524262 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 776/1547] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Jul 27 19:04:37 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 19:04:37.529881 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b46699d-e82b-4613-9bb5-dd0a8a8bd02e admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:04:37.579619 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4eaf63-82dc-43f3-af01-1bb1fb420937 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:04:37.594972 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b46699d-e82b-4613-9bb5-dd0a8a8bd02e admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:04:37.600066 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c3851-9e74-44b0-a5e6-cb24003d2079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6643b58dd5014772a6237180b96549c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:04:37.600676 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c3851-9e74-44b0-a5e6-cb24003d2079 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:04:37.600957 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c3851-9e74-44b0-a5e6-cb24003d2079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:04:37.601234 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c3851-9e74-44b0-a5e6-cb24003d2079 admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:04:37.601945 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c3851-9e74-44b0-a5e6-cb24003d2079 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:04:37.602954 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: WARNING py.warnings [None req-e57c3851-9e74-44b0-a5e6-cb24003d2079 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 19:04:37.602954 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: warnings.warn(msg) Jul 27 19:04:37.602954 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: Jul 27 19:04:37.604184 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c3851-9e74-44b0-a5e6-cb24003d2079 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:04:37.627083 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 777/1548] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Jul 27 19:04:37 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 19:04:37.631245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c3851-9e74-44b0-a5e6-cb24003d2079 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:04:37.636893 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a31cc-87a5-42d2-bd22-2f823a69ecc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6643b58dd5014772a6237180b96549c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:04:37.637553 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a31cc-87a5-42d2-bd22-2f823a69ecc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:04:37.637835 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a31cc-87a5-42d2-bd22-2f823a69ecc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:04:37.638131 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a31cc-87a5-42d2-bd22-2f823a69ecc2 admin admin] PATH_INFO: `/v3/users` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:04:37.638915 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a31cc-87a5-42d2-bd22-2f823a69ecc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:04:37.640709 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c3851-9e74-44b0-a5e6-cb24003d2079 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:04:37.641180 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a31cc-87a5-42d2-bd22-2f823a69ecc2 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:04:37.645264 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718b6fd-203c-4650-a640-88f073e8928c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6643b58dd5014772a6237180b96549c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:04:37.645868 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718b6fd-203c-4650-a640-88f073e8928c admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:04:37.646144 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718b6fd-203c-4650-a640-88f073e8928c admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:04:37.646412 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718b6fd-203c-4650-a640-88f073e8928c admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:04:37.647080 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d718b6fd-203c-4650-a640-88f073e8928c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:04:37.648793 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d718b6fd-203c-4650-a640-88f073e8928c admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:04:37.660730 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 778/1549] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Jul 27 19:04:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 19:04:37.664468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 772/1550] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Jul 27 19:04:37 2022] POST /identity/v3/users => generated 292 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 19:04:37.664762 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718b6fd-203c-4650-a640-88f073e8928c admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:04:37.668280 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a31cc-87a5-42d2-bd22-2f823a69ecc2 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:04:37.674462 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718b6fd-203c-4650-a640-88f073e8928c admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:04:37.678391 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a31cc-87a5-42d2-bd22-2f823a69ecc2 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:04:37.679536 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3937e900-b24a-4a5c-9979-520f54205408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6643b58dd5014772a6237180b96549c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:04:37.680159 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937e900-b24a-4a5c-9979-520f54205408 admin admin] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:04:37.680438 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937e900-b24a-4a5c-9979-520f54205408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:04:37.680707 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937e900-b24a-4a5c-9979-520f54205408 admin admin] PATH_INFO: `/v3/roles` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:04:37.681408 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3937e900-b24a-4a5c-9979-520f54205408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:04:37.682984 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3937e900-b24a-4a5c-9979-520f54205408 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:04:37.684360 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeaa571-b8a9-4a65-aafe-403a5a056b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6643b58dd5014772a6237180b96549c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:04:37.684963 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeaa571-b8a9-4a65-aafe-403a5a056b0e admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:04:37.685242 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeaa571-b8a9-4a65-aafe-403a5a056b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:04:37.685516 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeaa571-b8a9-4a65-aafe-403a5a056b0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:04:37.686322 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeaa571-b8a9-4a65-aafe-403a5a056b0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:04:37.687938 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeaa571-b8a9-4a65-aafe-403a5a056b0e admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:04:37.694374 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 779/1551] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Jul 27 19:04:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 19:04:37.698115 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 773/1552] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Jul 27 19:04:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 19:04:37.698444 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3937e900-b24a-4a5c-9979-520f54205408 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:04:37.702220 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeaa571-b8a9-4a65-aafe-403a5a056b0e admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:04:37.708484 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3937e900-b24a-4a5c-9979-520f54205408 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:04:37.711485 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeaa571-b8a9-4a65-aafe-403a5a056b0e admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:04:37.713210 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ada3ae-3d9e-4cd5-94fe-4381b5b72872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6643b58dd5014772a6237180b96549c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:04:37.713846 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ada3ae-3d9e-4cd5-94fe-4381b5b72872 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:04:37.714126 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ada3ae-3d9e-4cd5-94fe-4381b5b72872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:04:37.714398 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ada3ae-3d9e-4cd5-94fe-4381b5b72872 admin admin] PATH_INFO: `/v3/projects/3fac488ddb0649beb4af3e9fb463747d/users/ad9530d9267547f3a1179602c896b342/roles/448ae448fe9a474ab1166ca18f7ac4d8` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:04:37.716070 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292f05e-fbbf-4fd6-93b3-acd9cb851b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6643b58dd5014772a6237180b96549c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:04:37.716643 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292f05e-fbbf-4fd6-93b3-acd9cb851b5c admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:04:37.716921 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292f05e-fbbf-4fd6-93b3-acd9cb851b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:04:37.717194 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292f05e-fbbf-4fd6-93b3-acd9cb851b5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:04:37.717856 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d292f05e-fbbf-4fd6-93b3-acd9cb851b5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:04:37.719529 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d292f05e-fbbf-4fd6-93b3-acd9cb851b5c admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:04:37.728729 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ada3ae-3d9e-4cd5-94fe-4381b5b72872 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fac488ddb0649beb4af3e9fb463747d, user_id=ad9530d9267547f3a1179602c896b342, role_id=448ae448fe9a474ab1166ca18f7ac4d8)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:04:37.729876 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 774/1553] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Jul 27 19:04:37 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 19:04:37.733752 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292f05e-fbbf-4fd6-93b3-acd9cb851b5c admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:04:37.735922 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ada3ae-3d9e-4cd5-94fe-4381b5b72872 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:04:37.743616 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292f05e-fbbf-4fd6-93b3-acd9cb851b5c admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:04:37.749401 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 780/1554] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Jul 27 19:04:37 2022] PUT /identity/v3/projects/3fac488ddb0649beb4af3e9fb463747d/users/ad9530d9267547f3a1179602c896b342/roles/448ae448fe9a474ab1166ca18f7ac4d8 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 19:04:37.754354 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4956a7d-f4eb-4835-b4ae-8b4497fbbfbb None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:04:37.754648 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4956a7d-f4eb-4835-b4ae-8b4497fbbfbb None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:04:37.754921 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4956a7d-f4eb-4835-b4ae-8b4497fbbfbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:04:37.756075 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:04:37.774233 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-b4956a7d-f4eb-4835-b4ae-8b4497fbbfbb None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:04:37.775911 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-b4956a7d-f4eb-4835-b4ae-8b4497fbbfbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:04:37.802181 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b7a1f-1f44-4d29-bbca-63fe61d0bc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6643b58dd5014772a6237180b96549c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:04:37.802840 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b7a1f-1f44-4d29-bbca-63fe61d0bc56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:04:37.803184 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b7a1f-1f44-4d29-bbca-63fe61d0bc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:04:37.803456 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b7a1f-1f44-4d29-bbca-63fe61d0bc56 admin admin] PATH_INFO: `/v3/projects/18bc32d6d70543c681b79e6bcf8c9ade/users/2b44194e4fa143f3b6e9f891927b90a6/roles/448ae448fe9a474ab1166ca18f7ac4d8` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:04:37.818411 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:04:37.818838 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b7a1f-1f44-4d29-bbca-63fe61d0bc56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18bc32d6d70543c681b79e6bcf8c9ade, user_id=2b44194e4fa143f3b6e9f891927b90a6, role_id=448ae448fe9a474ab1166ca18f7ac4d8)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:04:37.820081 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: WARNING py.warnings [None req-974b7a1f-1f44-4d29-bbca-63fe61d0bc56 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 19:04:37.820081 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: warnings.warn(msg) Jul 27 19:04:37.820081 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: Jul 27 19:04:37.822113 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b7a1f-1f44-4d29-bbca-63fe61d0bc56 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:04:37.835992 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 775/1555] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Jul 27 19:04:37 2022] PUT /identity/v3/projects/18bc32d6d70543c681b79e6bcf8c9ade/users/2b44194e4fa143f3b6e9f891927b90a6/roles/448ae448fe9a474ab1166ca18f7ac4d8 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 19:04:37.840834 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c2dba-4d2d-45d7-a950-1bb098e84e7c None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:04:37.841118 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c2dba-4d2d-45d7-a950-1bb098e84e7c None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:04:37.841392 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c2dba-4d2d-45d7-a950-1bb098e84e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:04:37.842050 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 781/1556] 10.222.0.20 () {58 vars in 958 bytes} [Wed Jul 27 19:04:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 19:04:37.851846 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4956a7d-f4eb-4835-b4ae-8b4497fbbfbb None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:04:37.860826 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-930c2dba-4d2d-45d7-a950-1bb098e84e7c None None] MFA Rules not processed for user `a75f20e26df34773ae258f20480b0b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:04:37.862013 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-930c2dba-4d2d-45d7-a950-1bb098e84e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:04:37.911223 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4956a7d-f4eb-4835-b4ae-8b4497fbbfbb None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:04:37.925711 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 776/1557] 10.222.0.20 () {58 vars in 958 bytes} [Wed Jul 27 19:04:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 19:04:37.935777 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930c2dba-4d2d-45d7-a950-1bb098e84e7c None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:04:37.959713 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2726d04c-82ab-4aff-86eb-589766d03b0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703f0431d017405d942539de93a565b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:04:37.960347 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726d04c-82ab-4aff-86eb-589766d03b0b service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:04:37.960627 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726d04c-82ab-4aff-86eb-589766d03b0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:04:37.960904 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726d04c-82ab-4aff-86eb-589766d03b0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:04:37.970433 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2726d04c-82ab-4aff-86eb-589766d03b0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:04:37.971879 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2726d04c-82ab-4aff-86eb-589766d03b0b service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:04:37.981763 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 782/1558] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 19:04:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 19:04:37.990827 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930c2dba-4d2d-45d7-a950-1bb098e84e7c None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:04:37.994434 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0035f743-f606-4260-bcc2-ca8587d116cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703f0431d017405d942539de93a565b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:04:37.995056 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035f743-f606-4260-bcc2-ca8587d116cd service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:04:37.995335 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035f743-f606-4260-bcc2-ca8587d116cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:04:37.995607 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035f743-f606-4260-bcc2-ca8587d116cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:04:38.005100 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0035f743-f606-4260-bcc2-ca8587d116cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:04:38.006763 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0035f743-f606-4260-bcc2-ca8587d116cd service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:04:38.018639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 777/1559] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 19:04:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 19:04:43.138980 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5169b-5e72-423e-817c-6512edaca14c None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:04:43.139560 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5169b-5e72-423e-817c-6512edaca14c None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:04:43.139560 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5169b-5e72-423e-817c-6512edaca14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:04:43.177105 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-35a5169b-5e72-423e-817c-6512edaca14c None None] MFA Rules not processed for user `ad9530d9267547f3a1179602c896b342`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:04:43.178464 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-35a5169b-5e72-423e-817c-6512edaca14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:04:43.307126 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 783/1560] 10.222.0.20 () {58 vars in 958 bytes} [Wed Jul 27 19:04:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:04:43.311522 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0035f743-f606-4260-bcc2-ca8587d116cd service neutron] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:04:43.331406 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0035f743-f606-4260-bcc2-ca8587d116cd service neutron] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:04:43.343599 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d239396-0958-4ffe-8f80-82464bc942a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6643b58dd5014772a6237180b96549c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:04:43.345896 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d239396-0958-4ffe-8f80-82464bc942a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:04:43.345896 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d239396-0958-4ffe-8f80-82464bc942a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:04:43.345896 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d239396-0958-4ffe-8f80-82464bc942a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:04:43.349572 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d239396-0958-4ffe-8f80-82464bc942a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:04:43.351599 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d239396-0958-4ffe-8f80-82464bc942a4 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:04:43.399567 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 778/1561] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Jul 27 19:04:43 2022] POST /identity/v3/projects => generated 379 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 19:04:43.404860 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a5169b-5e72-423e-817c-6512edaca14c None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:04:43.424632 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a5169b-5e72-423e-817c-6512edaca14c None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:04:43.510606 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:04:43.559472 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8be2bd-49a4-47ca-9baf-e731689af51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6643b58dd5014772a6237180b96549c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:04:43.560932 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8be2bd-49a4-47ca-9baf-e731689af51f admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:04:43.561491 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8be2bd-49a4-47ca-9baf-e731689af51f admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:04:43.561949 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8be2bd-49a4-47ca-9baf-e731689af51f admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:04:43.563054 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8be2bd-49a4-47ca-9baf-e731689af51f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:04:43.566462 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8be2bd-49a4-47ca-9baf-e731689af51f admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:04:43.601482 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 784/1562] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Jul 27 19:04:43 2022] POST /identity/v3/users => generated 296 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 19:04:43.605824 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d239396-0958-4ffe-8f80-82464bc942a4 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:04:43.618643 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d239396-0958-4ffe-8f80-82464bc942a4 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:04:43.628469 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b8c4a-2fbd-447f-86cd-1cd60178126a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6643b58dd5014772a6237180b96549c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:04:43.629105 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b8c4a-2fbd-447f-86cd-1cd60178126a admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:04:43.629573 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b8c4a-2fbd-447f-86cd-1cd60178126a admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:04:43.629845 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b8c4a-2fbd-447f-86cd-1cd60178126a admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:04:43.630556 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55b8c4a-2fbd-447f-86cd-1cd60178126a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:04:43.632257 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55b8c4a-2fbd-447f-86cd-1cd60178126a admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:04:43.653058 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 779/1563] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Jul 27 19:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 19:04:43.655745 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8be2bd-49a4-47ca-9baf-e731689af51f admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:04:43.669785 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8be2bd-49a4-47ca-9baf-e731689af51f admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:04:43.676038 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f49e28-620d-466a-ba85-15905262aff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6643b58dd5014772a6237180b96549c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:04:43.677104 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f49e28-620d-466a-ba85-15905262aff1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:04:43.677490 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f49e28-620d-466a-ba85-15905262aff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:04:43.677879 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f49e28-620d-466a-ba85-15905262aff1 admin admin] PATH_INFO: `/v3/projects/17544c3a14e744519a381843f30d204e/users/1e3f6e084af64d72b0538dcd244974ac/roles/0f4a39b061e148418413cfe647af9a34` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:04:43.700857 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f49e28-620d-466a-ba85-15905262aff1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17544c3a14e744519a381843f30d204e, user_id=1e3f6e084af64d72b0538dcd244974ac, role_id=0f4a39b061e148418413cfe647af9a34)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:04:43.708379 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f49e28-620d-466a-ba85-15905262aff1 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:04:43.735988 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 785/1564] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Jul 27 19:04:43 2022] PUT /identity/v3/projects/17544c3a14e744519a381843f30d204e/users/1e3f6e084af64d72b0538dcd244974ac/roles/0f4a39b061e148418413cfe647af9a34 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 19:04:43.740407 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b8c4a-2fbd-447f-86cd-1cd60178126a admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:04:43.753755 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b8c4a-2fbd-447f-86cd-1cd60178126a admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:04:43.765933 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:04:43.803294 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e5382-89e0-4d4e-8862-66dbe3bd0233 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:04:43.803631 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e5382-89e0-4d4e-8862-66dbe3bd0233 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:04:43.803997 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e5382-89e0-4d4e-8862-66dbe3bd0233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:04:43.842258 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-bd9e5382-89e0-4d4e-8862-66dbe3bd0233 None None] MFA Rules not processed for user `2b44194e4fa143f3b6e9f891927b90a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:04:43.843732 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-bd9e5382-89e0-4d4e-8862-66dbe3bd0233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:04:43.854285 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa573b9-f915-49bf-a806-0a2ce10b2576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6643b58dd5014772a6237180b96549c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:04:43.855227 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa573b9-f915-49bf-a806-0a2ce10b2576 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:04:43.855567 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa573b9-f915-49bf-a806-0a2ce10b2576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:04:43.855927 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa573b9-f915-49bf-a806-0a2ce10b2576 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:04:43.856684 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa573b9-f915-49bf-a806-0a2ce10b2576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:04:43.858331 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa573b9-f915-49bf-a806-0a2ce10b2576 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:04:43.869120 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 780/1565] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Jul 27 19:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 19:04:43.873153 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa573b9-f915-49bf-a806-0a2ce10b2576 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:04:43.883494 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa573b9-f915-49bf-a806-0a2ce10b2576 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:04:43.889097 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d601a03e-8397-4010-9756-f7f20df179c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6643b58dd5014772a6237180b96549c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:04:43.890592 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601a03e-8397-4010-9756-f7f20df179c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:04:43.890909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601a03e-8397-4010-9756-f7f20df179c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:04:43.891197 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601a03e-8397-4010-9756-f7f20df179c7 admin admin] PATH_INFO: `/v3/projects/17544c3a14e744519a381843f30d204e/users/1e3f6e084af64d72b0538dcd244974ac/roles/0f4a39b061e148418413cfe647af9a34` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:04:43.893592 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d601a03e-8397-4010-9756-f7f20df179c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17544c3a14e744519a381843f30d204e, user_id=1e3f6e084af64d72b0538dcd244974ac, role_id=0f4a39b061e148418413cfe647af9a34)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:04:43.896460 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d601a03e-8397-4010-9756-f7f20df179c7 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:04:43.908291 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 781/1566] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Jul 27 19:04:43 2022] PUT /identity/v3/projects/17544c3a14e744519a381843f30d204e/users/1e3f6e084af64d72b0538dcd244974ac/roles/0f4a39b061e148418413cfe647af9a34 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 19:04:43.916788 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 786/1567] 10.222.0.20 () {58 vars in 958 bytes} [Wed Jul 27 19:04:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:04:43.921275 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d601a03e-8397-4010-9756-f7f20df179c7 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:04:44.001114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d601a03e-8397-4010-9756-f7f20df179c7 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:04:44.006517 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8231af4f-0d9d-4c31-b92d-c30ebcc2b291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6643b58dd5014772a6237180b96549c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:04:44.007293 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231af4f-0d9d-4c31-b92d-c30ebcc2b291 admin admin] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:04:44.007568 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231af4f-0d9d-4c31-b92d-c30ebcc2b291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:04:44.007878 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231af4f-0d9d-4c31-b92d-c30ebcc2b291 admin admin] PATH_INFO: `/v3/projects` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:04:44.008557 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8231af4f-0d9d-4c31-b92d-c30ebcc2b291 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:04:44.010503 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8231af4f-0d9d-4c31-b92d-c30ebcc2b291 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:04:44.056527 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 782/1568] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Jul 27 19:04:43 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 19:04:44.057118 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e5382-89e0-4d4e-8862-66dbe3bd0233 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:04:44.070053 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e5382-89e0-4d4e-8862-66dbe3bd0233 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:04:44.169971 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72640efe-fefd-455b-be35-7bacf90f3f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6643b58dd5014772a6237180b96549c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:04:44.170697 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72640efe-fefd-455b-be35-7bacf90f3f01 admin admin] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:04:44.171039 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72640efe-fefd-455b-be35-7bacf90f3f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:04:44.171423 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72640efe-fefd-455b-be35-7bacf90f3f01 admin admin] PATH_INFO: `/v3/users` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:04:44.172121 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72640efe-fefd-455b-be35-7bacf90f3f01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:04:44.175473 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72640efe-fefd-455b-be35-7bacf90f3f01 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:04:44.210455 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 787/1569] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Jul 27 19:04:44 2022] POST /identity/v3/users => generated 299 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 19:04:44.215205 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8231af4f-0d9d-4c31-b92d-c30ebcc2b291 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:04:44.228896 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8231af4f-0d9d-4c31-b92d-c30ebcc2b291 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:04:44.246220 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a019f29-9fa2-45d2-89dd-c28c861da4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6643b58dd5014772a6237180b96549c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:04:44.247631 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a019f29-9fa2-45d2-89dd-c28c861da4bc admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:04:44.248193 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a019f29-9fa2-45d2-89dd-c28c861da4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:04:44.248871 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a019f29-9fa2-45d2-89dd-c28c861da4bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:04:44.251003 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a019f29-9fa2-45d2-89dd-c28c861da4bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:04:44.253077 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a019f29-9fa2-45d2-89dd-c28c861da4bc admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:04:44.267961 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 783/1570] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Jul 27 19:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 19:04:44.272680 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72640efe-fefd-455b-be35-7bacf90f3f01 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:04:44.286892 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72640efe-fefd-455b-be35-7bacf90f3f01 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:04:44.292871 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d91a57-c092-4a85-9db3-c72646468658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6643b58dd5014772a6237180b96549c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:04:44.293569 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d91a57-c092-4a85-9db3-c72646468658 admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:04:44.293847 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d91a57-c092-4a85-9db3-c72646468658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:04:44.294114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d91a57-c092-4a85-9db3-c72646468658 admin admin] PATH_INFO: `/v3/projects/bdf017012c8c4113a3a10cd6764956f9/users/7a991cdd2f11414fa8661188117712eb/roles/0f4a39b061e148418413cfe647af9a34` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:04:44.328004 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d91a57-c092-4a85-9db3-c72646468658 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdf017012c8c4113a3a10cd6764956f9, user_id=7a991cdd2f11414fa8661188117712eb, role_id=0f4a39b061e148418413cfe647af9a34)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:04:44.334501 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d91a57-c092-4a85-9db3-c72646468658 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:04:44.343657 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:04:44.359727 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 788/1571] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Jul 27 19:04:44 2022] PUT /identity/v3/projects/bdf017012c8c4113a3a10cd6764956f9/users/7a991cdd2f11414fa8661188117712eb/roles/0f4a39b061e148418413cfe647af9a34 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:04:44.363942 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a019f29-9fa2-45d2-89dd-c28c861da4bc admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:04:44.375093 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a019f29-9fa2-45d2-89dd-c28c861da4bc admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:04:44.493425 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf54e8-948d-4ed1-9b4c-f584ddfea2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6643b58dd5014772a6237180b96549c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:04:44.494088 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf54e8-948d-4ed1-9b4c-f584ddfea2d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:04:44.494373 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf54e8-948d-4ed1-9b4c-f584ddfea2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:04:44.494646 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf54e8-948d-4ed1-9b4c-f584ddfea2d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:04:44.495349 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf54e8-948d-4ed1-9b4c-f584ddfea2d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:04:44.511443 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf54e8-948d-4ed1-9b4c-f584ddfea2d6 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:04:44.548566 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 784/1572] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Jul 27 19:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 19:04:44.549743 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d91a57-c092-4a85-9db3-c72646468658 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:04:44.563215 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d91a57-c092-4a85-9db3-c72646468658 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:04:44.569143 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d0de4-0936-47e9-8453-a4233598915c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6643b58dd5014772a6237180b96549c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:04:44.570020 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d0de4-0936-47e9-8453-a4233598915c admin admin] REQUEST_METHOD: `PUT` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:04:44.570311 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d0de4-0936-47e9-8453-a4233598915c admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:04:44.570587 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d0de4-0936-47e9-8453-a4233598915c admin admin] PATH_INFO: `/v3/projects/bdf017012c8c4113a3a10cd6764956f9/users/7a991cdd2f11414fa8661188117712eb/roles/0f4a39b061e148418413cfe647af9a34` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:04:44.573171 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9d0de4-0936-47e9-8453-a4233598915c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdf017012c8c4113a3a10cd6764956f9, user_id=7a991cdd2f11414fa8661188117712eb, role_id=0f4a39b061e148418413cfe647af9a34)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:04:44.576453 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9d0de4-0936-47e9-8453-a4233598915c admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:04:44.595856 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 789/1573] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Jul 27 19:04:44 2022] PUT /identity/v3/projects/bdf017012c8c4113a3a10cd6764956f9/users/7a991cdd2f11414fa8661188117712eb/roles/0f4a39b061e148418413cfe647af9a34 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:04:50.142697 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ed2e0-c5df-4533-8157-b2577e4b2d18 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:04:50.143209 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ed2e0-c5df-4533-8157-b2577e4b2d18 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:04:50.143281 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ed2e0-c5df-4533-8157-b2577e4b2d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:04:50.195783 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:04:50.250008 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-986ed2e0-c5df-4533-8157-b2577e4b2d18 None None] MFA Rules not processed for user `1e3f6e084af64d72b0538dcd244974ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:04:50.251609 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-986ed2e0-c5df-4533-8157-b2577e4b2d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:04:50.425048 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 785/1574] 10.222.0.20 () {58 vars in 958 bytes} [Wed Jul 27 19:04:50 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:04:50.440173 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d0de4-0936-47e9-8453-a4233598915c admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:04:50.442193 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-4c9d0de4-0936-47e9-8453-a4233598915c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:04:50.572815 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d0de4-0936-47e9-8453-a4233598915c admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:04:50.591854 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b6295-6f6f-48be-975d-5c90f2436f2d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c4b9109e80b4ae19a7c31de1cd9d2b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:04:50.592664 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b6295-6f6f-48be-975d-5c90f2436f2d service glance] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:04:50.593145 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b6295-6f6f-48be-975d-5c90f2436f2d service glance] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:04:50.593736 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b6295-6f6f-48be-975d-5c90f2436f2d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:04:50.735237 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353b6295-6f6f-48be-975d-5c90f2436f2d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:04:50.738132 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353b6295-6f6f-48be-975d-5c90f2436f2d service glance] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:04:50.753323 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 790/1575] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 19:04:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:04:51.075186 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6da665-0eca-42c4-939c-a0be3adf4da6 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:04:51.075478 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6da665-0eca-42c4-939c-a0be3adf4da6 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:04:51.075778 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6da665-0eca-42c4-939c-a0be3adf4da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:04:51.130722 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-7e6da665-0eca-42c4-939c-a0be3adf4da6 None None] MFA Rules not processed for user `7a991cdd2f11414fa8661188117712eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:04:51.132017 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-7e6da665-0eca-42c4-939c-a0be3adf4da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:04:51.227450 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 786/1576] 10.222.0.20 () {58 vars in 958 bytes} [Wed Jul 27 19:04:51 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:04:51.237545 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b6295-6f6f-48be-975d-5c90f2436f2d service glance] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:04:51.248626 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b6295-6f6f-48be-975d-5c90f2436f2d service glance] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:04:51.253207 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4c602-57d0-46cb-b61a-59fcbbaf7168 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c4b9109e80b4ae19a7c31de1cd9d2b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:04:51.253845 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4c602-57d0-46cb-b61a-59fcbbaf7168 service glance] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:04:51.254128 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4c602-57d0-46cb-b61a-59fcbbaf7168 service glance] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:04:51.254405 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4c602-57d0-46cb-b61a-59fcbbaf7168 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:04:51.349125 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe4c602-57d0-46cb-b61a-59fcbbaf7168 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:04:51.351530 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe4c602-57d0-46cb-b61a-59fcbbaf7168 service glance] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:04:51.372451 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 791/1577] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 19:04:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:04:51.701183 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb67fae-4a27-4553-bb51-04d9593d8c04 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:04:51.701627 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb67fae-4a27-4553-bb51-04d9593d8c04 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:04:51.702134 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb67fae-4a27-4553-bb51-04d9593d8c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:04:51.789642 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-bcb67fae-4a27-4553-bb51-04d9593d8c04 None None] MFA Rules not processed for user `a277ddae777442869114c4c5deff7d7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:04:51.791101 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-bcb67fae-4a27-4553-bb51-04d9593d8c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:04:51.864727 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:04:51.922586 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 787/1578] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Jul 27 19:04:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 19:04:52.081589 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4c602-57d0-46cb-b61a-59fcbbaf7168 service glance] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:04:52.083158 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-7fe4c602-57d0-46cb-b61a-59fcbbaf7168 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:04:52.105401 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:04:52.213144 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4c602-57d0-46cb-b61a-59fcbbaf7168 service glance] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:04:52.218209 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1857cd7-37ca-454e-a684-65802c2cf7cb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a9f1909ab3458c8c131986e303831a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:04:52.218938 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1857cd7-37ca-454e-a684-65802c2cf7cb service swift] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:04:52.219104 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1857cd7-37ca-454e-a684-65802c2cf7cb service swift] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:04:52.219372 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1857cd7-37ca-454e-a684-65802c2cf7cb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:04:52.228432 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1857cd7-37ca-454e-a684-65802c2cf7cb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:04:52.230001 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1857cd7-37ca-454e-a684-65802c2cf7cb service swift] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:04:52.239433 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 792/1579] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Jul 27 19:04:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 19:04:52.633798 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29042ce-2f65-4fa8-9f33-3e9913ff9aea None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:04:52.634292 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29042ce-2f65-4fa8-9f33-3e9913ff9aea None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:04:52.634373 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29042ce-2f65-4fa8-9f33-3e9913ff9aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:04:52.660283 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-d29042ce-2f65-4fa8-9f33-3e9913ff9aea None None] MFA Rules not processed for user `a277ddae777442869114c4c5deff7d7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:04:52.661770 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-d29042ce-2f65-4fa8-9f33-3e9913ff9aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:04:52.670651 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 788/1580] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Jul 27 19:04:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:04:52.687503 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1857cd7-37ca-454e-a684-65802c2cf7cb service swift] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:04:52.700039 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1857cd7-37ca-454e-a684-65802c2cf7cb service swift] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:04:52.705851 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f2d1f-f905-460c-abd8-e494f4c9139a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a9f1909ab3458c8c131986e303831a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:04:52.706469 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f2d1f-f905-460c-abd8-e494f4c9139a service swift] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:04:52.706796 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f2d1f-f905-460c-abd8-e494f4c9139a service swift] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:04:52.707072 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f2d1f-f905-460c-abd8-e494f4c9139a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:04:52.716522 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113f2d1f-f905-460c-abd8-e494f4c9139a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:04:52.724073 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113f2d1f-f905-460c-abd8-e494f4c9139a service swift] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:04:52.735329 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 793/1581] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Jul 27 19:04:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 19:05:02.139845 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88653ee-f26d-44f7-bb27-e067701411cd None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:02.140356 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88653ee-f26d-44f7-bb27-e067701411cd None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:02.140519 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88653ee-f26d-44f7-bb27-e067701411cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:02.160360 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-f88653ee-f26d-44f7-bb27-e067701411cd None None] MFA Rules not processed for user `2b44194e4fa143f3b6e9f891927b90a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:05:02.161577 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-f88653ee-f26d-44f7-bb27-e067701411cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:05:02.169211 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 789/1582] 10.222.0.20 () {58 vars in 958 bytes} [Wed Jul 27 19:05:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:05:02.476946 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d66824-3f4a-40cc-b38e-37fcb4c312db None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:02.477475 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d66824-3f4a-40cc-b38e-37fcb4c312db None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:02.477475 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d66824-3f4a-40cc-b38e-37fcb4c312db None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:02.478926 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 794/1583] 10.222.0.20 () {54 vars in 962 bytes} [Wed Jul 27 19:05:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:05:02.484732 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eefea2c-de93-4245-9b4a-a4226f8a5292 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:02.485088 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eefea2c-de93-4245-9b4a-a4226f8a5292 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:02.485430 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eefea2c-de93-4245-9b4a-a4226f8a5292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:02.522180 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-1eefea2c-de93-4245-9b4a-a4226f8a5292 None None] MFA Rules not processed for user `17fbef9db7734283aaad4962ee160171`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:05:02.523476 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-1eefea2c-de93-4245-9b4a-a4226f8a5292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:05:02.594258 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 790/1584] 10.222.0.20 () {58 vars in 1059 bytes} [Wed Jul 27 19:05:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:05:02.599580 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793375e1-b46e-492c-8d8e-2c22fdd00cbb None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:02.599896 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793375e1-b46e-492c-8d8e-2c22fdd00cbb None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:02.600176 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793375e1-b46e-492c-8d8e-2c22fdd00cbb None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:02.601548 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 795/1585] 10.222.0.20 () {54 vars in 912 bytes} [Wed Jul 27 19:05:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:05:02.606414 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613dba9-a89e-4714-b382-21ed3fbc33af None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:02.606698 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613dba9-a89e-4714-b382-21ed3fbc33af None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:02.606969 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613dba9-a89e-4714-b382-21ed3fbc33af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:02.626678 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-8613dba9-a89e-4714-b382-21ed3fbc33af None None] MFA Rules not processed for user `17fbef9db7734283aaad4962ee160171`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:05:02.627891 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-8613dba9-a89e-4714-b382-21ed3fbc33af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:05:02.637443 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 791/1586] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Jul 27 19:05:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:05:02.648978 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793375e1-b46e-492c-8d8e-2c22fdd00cbb None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:05:02.650866 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-793375e1-b46e-492c-8d8e-2c22fdd00cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:05:02.674152 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793375e1-b46e-492c-8d8e-2c22fdd00cbb None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:05:02.678245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabcd715-4e5b-4c9c-bc03-a8908f904128 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c4b9109e80b4ae19a7c31de1cd9d2b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:05:02.679080 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabcd715-4e5b-4c9c-bc03-a8908f904128 service glance] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:02.679422 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabcd715-4e5b-4c9c-bc03-a8908f904128 service glance] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:02.679928 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabcd715-4e5b-4c9c-bc03-a8908f904128 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:02.691922 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabcd715-4e5b-4c9c-bc03-a8908f904128 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:05:02.693445 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabcd715-4e5b-4c9c-bc03-a8908f904128 service glance] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:05:02.706245 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 796/1587] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 19:05:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:05:03.077782 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a506fc-cf19-4c2f-b72a-ec59884e17e8 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:03.078168 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a506fc-cf19-4c2f-b72a-ec59884e17e8 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:03.078487 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a506fc-cf19-4c2f-b72a-ec59884e17e8 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:03.083067 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 792/1588] 10.222.0.20 () {54 vars in 912 bytes} [Wed Jul 27 19:05:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:05:03.090204 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c8ed4-7283-4d07-af69-8916914d4159 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:03.090590 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c8ed4-7283-4d07-af69-8916914d4159 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:03.090927 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c8ed4-7283-4d07-af69-8916914d4159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:03.133137 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-f35c8ed4-7283-4d07-af69-8916914d4159 None None] MFA Rules not processed for user `703f0431d017405d942539de93a565b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:05:03.134351 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-f35c8ed4-7283-4d07-af69-8916914d4159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:05:03.194173 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 797/1589] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Jul 27 19:05:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:05:03.200543 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a506fc-cf19-4c2f-b72a-ec59884e17e8 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:05:03.212261 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a506fc-cf19-4c2f-b72a-ec59884e17e8 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:05:03.216122 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b870fef7-2940-4645-bf89-6b9b230bf0cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703f0431d017405d942539de93a565b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:05:03.216758 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b870fef7-2940-4645-bf89-6b9b230bf0cd service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:03.217041 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b870fef7-2940-4645-bf89-6b9b230bf0cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:03.217309 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b870fef7-2940-4645-bf89-6b9b230bf0cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:03.226472 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b870fef7-2940-4645-bf89-6b9b230bf0cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:05:03.228400 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b870fef7-2940-4645-bf89-6b9b230bf0cd service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:05:03.241004 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 793/1590] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 19:05:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 19:05:03.662719 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f9510-83fe-4bd1-957a-1922362bdc1b None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:03.663148 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f9510-83fe-4bd1-957a-1922362bdc1b None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:03.663298 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f9510-83fe-4bd1-957a-1922362bdc1b None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:03.664810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 798/1591] 10.222.0.20 () {54 vars in 962 bytes} [Wed Jul 27 19:05:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:05:03.670269 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b212f7-1317-4ac6-9ad8-97d67f5a41fe None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:03.670553 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b212f7-1317-4ac6-9ad8-97d67f5a41fe None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:03.670827 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b212f7-1317-4ac6-9ad8-97d67f5a41fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:03.681067 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8d9e1-bcc0-440e-90f3-0536c2729218 None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:03.681640 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8d9e1-bcc0-440e-90f3-0536c2729218 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:03.681951 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8d9e1-bcc0-440e-90f3-0536c2729218 None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:03.684011 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 799/1592] 10.222.0.20 () {54 vars in 961 bytes} [Wed Jul 27 19:05:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 19:05:03.688805 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abea3f5-9e92-4ab1-aa32-088a47e672a2 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:03.689089 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abea3f5-9e92-4ab1-aa32-088a47e672a2 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:03.689647 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abea3f5-9e92-4ab1-aa32-088a47e672a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:03.695179 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-e4b212f7-1317-4ac6-9ad8-97d67f5a41fe None None] MFA Rules not processed for user `17fbef9db7734283aaad4962ee160171`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:05:03.696596 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-e4b212f7-1317-4ac6-9ad8-97d67f5a41fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:05:03.709268 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 794/1593] 10.222.0.20 () {58 vars in 1059 bytes} [Wed Jul 27 19:05:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:05:03.713440 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7006ec-38b6-46db-a67f-aa5c52fb7846 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:03.713870 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7006ec-38b6-46db-a67f-aa5c52fb7846 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:03.714884 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7006ec-38b6-46db-a67f-aa5c52fb7846 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:03.716738 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-9abea3f5-9e92-4ab1-aa32-088a47e672a2 None None] MFA Rules not processed for user `3b0382b170fb49e785a57bbb329d4b37`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:05:03.718244 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-9abea3f5-9e92-4ab1-aa32-088a47e672a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:05:03.720377 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 795/1594] 10.222.0.20 () {54 vars in 912 bytes} [Wed Jul 27 19:05:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 19:05:03.728496 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140aedf-c143-4700-a626-dc413790658d None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:03.729635 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140aedf-c143-4700-a626-dc413790658d None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:03.730087 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140aedf-c143-4700-a626-dc413790658d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:03.780028 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-9140aedf-c143-4700-a626-dc413790658d None None] MFA Rules not processed for user `17fbef9db7734283aaad4962ee160171`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:05:03.781385 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-9140aedf-c143-4700-a626-dc413790658d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:05:03.800450 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 796/1595] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Jul 27 19:05:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:05:03.806585 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140aedf-c143-4700-a626-dc413790658d None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:05:03.819677 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140aedf-c143-4700-a626-dc413790658d None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:05:03.825536 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d5bb7b-2169-4d60-9173-337ab2c7cd98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703f0431d017405d942539de93a565b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:05:03.826363 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5bb7b-2169-4d60-9173-337ab2c7cd98 service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:03.826792 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5bb7b-2169-4d60-9173-337ab2c7cd98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:03.827202 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5bb7b-2169-4d60-9173-337ab2c7cd98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:03.831239 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:05:03.840932 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d5bb7b-2169-4d60-9173-337ab2c7cd98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:05:03.843054 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d5bb7b-2169-4d60-9173-337ab2c7cd98 service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:05:03.855291 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 800/1596] 10.222.0.20 () {58 vars in 1058 bytes} [Wed Jul 27 19:05:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 19:05:03.863662 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abea3f5-9e92-4ab1-aa32-088a47e672a2 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:05:03.864871 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 797/1597] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 19:05:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 19:05:03.877704 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abea3f5-9e92-4ab1-aa32-088a47e672a2 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:05:03.886897 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f4cd3f-381a-4c53-ae8d-502ae0d58253 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b0382b170fb49e785a57bbb329d4b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:05:03.888367 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f4cd3f-381a-4c53-ae8d-502ae0d58253 service placement] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:03.888990 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f4cd3f-381a-4c53-ae8d-502ae0d58253 service placement] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:03.889584 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f4cd3f-381a-4c53-ae8d-502ae0d58253 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:03.892954 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-15f4cd3f-381a-4c53-ae8d-502ae0d58253 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:05:03.906484 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f4cd3f-381a-4c53-ae8d-502ae0d58253 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:05:03.908107 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f4cd3f-381a-4c53-ae8d-502ae0d58253 service placement] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:05:03.920991 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 801/1598] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 19:05:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:05:05.758829 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8f731-eeb6-4474-9ffb-4bef73ab64c7 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:05.759905 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8f731-eeb6-4474-9ffb-4bef73ab64c7 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:05.760387 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8f731-eeb6-4474-9ffb-4bef73ab64c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:05.780951 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-a1a8f731-eeb6-4474-9ffb-4bef73ab64c7 None None] MFA Rules not processed for user `a277ddae777442869114c4c5deff7d7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:05:05.782173 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-a1a8f731-eeb6-4474-9ffb-4bef73ab64c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:05:05.799419 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 798/1599] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Jul 27 19:05:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:05:05.812358 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f4cd3f-381a-4c53-ae8d-502ae0d58253 service placement] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:05:05.830530 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f4cd3f-381a-4c53-ae8d-502ae0d58253 service placement] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:05:05.838102 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26313fc7-93e6-4bce-b0c7-73e3ba78f4e1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a9f1909ab3458c8c131986e303831a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:05:05.839426 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26313fc7-93e6-4bce-b0c7-73e3ba78f4e1 service swift] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:05.839910 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26313fc7-93e6-4bce-b0c7-73e3ba78f4e1 service swift] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:05.840473 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26313fc7-93e6-4bce-b0c7-73e3ba78f4e1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:05.851806 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26313fc7-93e6-4bce-b0c7-73e3ba78f4e1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:05:05.854438 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26313fc7-93e6-4bce-b0c7-73e3ba78f4e1 service swift] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:05:05.865574 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 802/1600] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Jul 27 19:05:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 19:05:15.776195 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=73 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:05:15.862075 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=16 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:05:21.557041 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee2ac4-f644-4787-8551-3cb41f7b862b None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:21.557548 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee2ac4-f644-4787-8551-3cb41f7b862b None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:21.557640 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee2ac4-f644-4787-8551-3cb41f7b862b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:21.577400 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-70ee2ac4-f644-4787-8551-3cb41f7b862b None None] MFA Rules not processed for user `703f0431d017405d942539de93a565b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:05:21.578587 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-70ee2ac4-f644-4787-8551-3cb41f7b862b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:05:21.585036 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 799/1601] 10.222.0.45 () {58 vars in 1015 bytes} [Wed Jul 27 19:05:21 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:05:21.596559 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26313fc7-93e6-4bce-b0c7-73e3ba78f4e1 service swift] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:05:21.605946 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26313fc7-93e6-4bce-b0c7-73e3ba78f4e1 service swift] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:05:21.609711 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46c6560-322c-4c33-9c99-94a7305b2cd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703f0431d017405d942539de93a565b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:05:21.610305 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c6560-322c-4c33-9c99-94a7305b2cd0 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:21.610582 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c6560-322c-4c33-9c99-94a7305b2cd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:21.610856 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c6560-322c-4c33-9c99-94a7305b2cd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:21.617721 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46c6560-322c-4c33-9c99-94a7305b2cd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:05:21.619952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46c6560-322c-4c33-9c99-94a7305b2cd0 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:05:21.628330 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 803/1602] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 19:05:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:05:22.435299 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b975ec2-df7e-4151-af4a-32abcd54d51e None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:22.435590 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b975ec2-df7e-4151-af4a-32abcd54d51e None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:22.435892 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b975ec2-df7e-4151-af4a-32abcd54d51e None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:22.437275 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 800/1603] 10.222.0.20 () {54 vars in 921 bytes} [Wed Jul 27 19:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:05:22.444308 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3477a03-080b-4132-8605-832e4f576695 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:22.444594 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3477a03-080b-4132-8605-832e4f576695 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:22.444868 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3477a03-080b-4132-8605-832e4f576695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:22.468329 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-a3477a03-080b-4132-8605-832e4f576695 None None] MFA Rules not processed for user `17fbef9db7734283aaad4962ee160171`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:05:22.469548 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a3477a03-080b-4132-8605-832e4f576695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:05:22.478872 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 804/1604] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Jul 27 19:05:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:05:22.492278 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b975ec2-df7e-4151-af4a-32abcd54d51e None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:05:22.514260 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b975ec2-df7e-4151-af4a-32abcd54d51e None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:05:22.520664 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc43764-a013-4e88-a81d-ed58ea21fa87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17fbef9db7734283aaad4962ee160171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:05:22.521415 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc43764-a013-4e88-a81d-ed58ea21fa87 service nova] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:22.521767 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc43764-a013-4e88-a81d-ed58ea21fa87 service nova] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:22.522114 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc43764-a013-4e88-a81d-ed58ea21fa87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:22.537251 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc43764-a013-4e88-a81d-ed58ea21fa87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:05:22.538969 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc43764-a013-4e88-a81d-ed58ea21fa87 service nova] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:05:22.580127 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 801/1605] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 19:05:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:05:29.557023 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00445622-a1a8-46d9-ad03-2a8a8ddb8dcc None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:29.557577 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00445622-a1a8-46d9-ad03-2a8a8ddb8dcc None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:29.557673 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00445622-a1a8-46d9-ad03-2a8a8ddb8dcc None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:29.559111 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 805/1606] 10.222.0.20 () {54 vars in 921 bytes} [Wed Jul 27 19:05:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:05:29.568267 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae467bef-ceba-446b-96b5-070344f8610d None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:29.568773 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae467bef-ceba-446b-96b5-070344f8610d None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:29.568859 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae467bef-ceba-446b-96b5-070344f8610d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:29.591384 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-ae467bef-ceba-446b-96b5-070344f8610d None None] MFA Rules not processed for user `17fbef9db7734283aaad4962ee160171`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:05:29.592608 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-ae467bef-ceba-446b-96b5-070344f8610d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:05:29.601860 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 802/1607] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Jul 27 19:05:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:05:29.617382 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00445622-a1a8-46d9-ad03-2a8a8ddb8dcc None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:05:29.632895 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00445622-a1a8-46d9-ad03-2a8a8ddb8dcc None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:05:29.639288 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b04e860-4197-44b2-9c1d-9004364ffa07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17fbef9db7734283aaad4962ee160171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:05:29.639953 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04e860-4197-44b2-9c1d-9004364ffa07 service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:29.640229 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04e860-4197-44b2-9c1d-9004364ffa07 service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:29.640499 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04e860-4197-44b2-9c1d-9004364ffa07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:29.652258 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b04e860-4197-44b2-9c1d-9004364ffa07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:05:29.653842 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b04e860-4197-44b2-9c1d-9004364ffa07 service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:05:29.667594 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 806/1608] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 19:05:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:05:39.586338 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=12 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:05:39.660853 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=15 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:05:48.485645 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fdc2d5-bf04-47c7-9d23-5b2aae6507d6 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:48.486130 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fdc2d5-bf04-47c7-9d23-5b2aae6507d6 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:48.486214 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fdc2d5-bf04-47c7-9d23-5b2aae6507d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:48.505041 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-e6fdc2d5-bf04-47c7-9d23-5b2aae6507d6 None None] MFA Rules not processed for user `ad9530d9267547f3a1179602c896b342`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:05:48.506209 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-e6fdc2d5-bf04-47c7-9d23-5b2aae6507d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:05:48.512930 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 803/1609] 10.222.0.20 () {58 vars in 958 bytes} [Wed Jul 27 19:05:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:05:48.828766 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59762e-273a-4503-b26b-576435d78d88 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:48.829246 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59762e-273a-4503-b26b-576435d78d88 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:48.829334 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59762e-273a-4503-b26b-576435d78d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:48.848040 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-df59762e-273a-4503-b26b-576435d78d88 None None] MFA Rules not processed for user `703f0431d017405d942539de93a565b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:05:48.849234 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-df59762e-273a-4503-b26b-576435d78d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:05:48.855655 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 807/1610] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Jul 27 19:05:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:05:48.866837 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fdc2d5-bf04-47c7-9d23-5b2aae6507d6 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:05:48.877202 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fdc2d5-bf04-47c7-9d23-5b2aae6507d6 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:05:48.881812 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c306443-6577-431a-b8fc-23f2310c99fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703f0431d017405d942539de93a565b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:05:48.882423 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c306443-6577-431a-b8fc-23f2310c99fd service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:48.882699 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c306443-6577-431a-b8fc-23f2310c99fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:48.883018 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c306443-6577-431a-b8fc-23f2310c99fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:48.890917 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c306443-6577-431a-b8fc-23f2310c99fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:05:48.892363 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c306443-6577-431a-b8fc-23f2310c99fd service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:05:48.899948 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 804/1611] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 19:05:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:05:55.911394 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df59762e-273a-4503-b26b-576435d78d88 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:05:55.921357 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df59762e-273a-4503-b26b-576435d78d88 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:05:55.926052 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc92a93-b8a7-4cbd-affd-e6397948b144 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703f0431d017405d942539de93a565b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:05:55.926695 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc92a93-b8a7-4cbd-affd-e6397948b144 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:55.926974 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc92a93-b8a7-4cbd-affd-e6397948b144 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:55.927244 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc92a93-b8a7-4cbd-affd-e6397948b144 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:55.938350 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc92a93-b8a7-4cbd-affd-e6397948b144 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:05:55.939877 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc92a93-b8a7-4cbd-affd-e6397948b144 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:05:55.951016 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 808/1612] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 19:05:55 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:05:56.613867 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c4b91-e127-4d7d-8fee-8e6554b03a4d None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:56.614417 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c4b91-e127-4d7d-8fee-8e6554b03a4d None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:56.614417 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c4b91-e127-4d7d-8fee-8e6554b03a4d None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:56.616310 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 805/1613] 10.222.0.20 () {54 vars in 921 bytes} [Wed Jul 27 19:05:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:05:56.656292 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecbb2c0-c52d-424e-ae0d-56da8803645d None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:56.656644 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecbb2c0-c52d-424e-ae0d-56da8803645d None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:56.656921 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecbb2c0-c52d-424e-ae0d-56da8803645d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:56.685468 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-fecbb2c0-c52d-424e-ae0d-56da8803645d None None] MFA Rules not processed for user `17fbef9db7734283aaad4962ee160171`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:05:56.686744 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-fecbb2c0-c52d-424e-ae0d-56da8803645d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:05:56.697890 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 809/1614] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Jul 27 19:05:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:05:56.710874 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c4b91-e127-4d7d-8fee-8e6554b03a4d None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:05:56.725673 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c4b91-e127-4d7d-8fee-8e6554b03a4d None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:05:56.732048 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0b696-bb43-4c0c-b305-22fdc36c8409 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17fbef9db7734283aaad4962ee160171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:05:56.733145 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0b696-bb43-4c0c-b305-22fdc36c8409 service nova] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:56.733931 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0b696-bb43-4c0c-b305-22fdc36c8409 service nova] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:56.734339 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0b696-bb43-4c0c-b305-22fdc36c8409 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:56.744863 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0b696-bb43-4c0c-b305-22fdc36c8409 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:05:56.746477 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0b696-bb43-4c0c-b305-22fdc36c8409 service nova] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:05:56.756996 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 806/1615] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 19:05:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:06:06.674345 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=12 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:06:06.752576 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=15 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:06:45.481232 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3fcd16-390a-412a-8394-28988113c311 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:45.481753 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3fcd16-390a-412a-8394-28988113c311 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:45.481852 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3fcd16-390a-412a-8394-28988113c311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:45.500912 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-ec3fcd16-390a-412a-8394-28988113c311 None None] MFA Rules not processed for user `ad9530d9267547f3a1179602c896b342`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:06:45.502044 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-ec3fcd16-390a-412a-8394-28988113c311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:06:45.508762 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 810/1616] 10.222.0.20 () {58 vars in 958 bytes} [Wed Jul 27 19:06:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:06:55.495788 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:07:03.334014 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a831f1-44a6-40e6-b72e-55d67e1b3e1d None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:07:03.335098 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a831f1-44a6-40e6-b72e-55d67e1b3e1d None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:07:03.335098 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a831f1-44a6-40e6-b72e-55d67e1b3e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:07:03.358288 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-c2a831f1-44a6-40e6-b72e-55d67e1b3e1d None None] MFA Rules not processed for user `a277ddae777442869114c4c5deff7d7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:07:03.362163 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-c2a831f1-44a6-40e6-b72e-55d67e1b3e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:07:03.372321 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 807/1617] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Jul 27 19:07:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:07:03.418256 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3fcd16-390a-412a-8394-28988113c311 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:07:03.430426 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3fcd16-390a-412a-8394-28988113c311 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:07:03.435288 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede666e-2cca-4206-84d9-d70563ed5152 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a9f1909ab3458c8c131986e303831a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:07:03.435926 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede666e-2cca-4206-84d9-d70563ed5152 service swift] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:07:03.436206 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede666e-2cca-4206-84d9-d70563ed5152 service swift] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:07:03.436478 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede666e-2cca-4206-84d9-d70563ed5152 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:07:03.444371 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cede666e-2cca-4206-84d9-d70563ed5152 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:07:03.445964 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cede666e-2cca-4206-84d9-d70563ed5152 service swift] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:07:03.453826 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 811/1618] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Jul 27 19:07:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 19:07:08.838797 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da330e-e04f-4a34-a6fa-fd5db9d65026 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:07:08.839284 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da330e-e04f-4a34-a6fa-fd5db9d65026 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:07:08.839372 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da330e-e04f-4a34-a6fa-fd5db9d65026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:07:08.858738 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-f2da330e-e04f-4a34-a6fa-fd5db9d65026 None None] MFA Rules not processed for user `ad9530d9267547f3a1179602c896b342`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:07:08.859950 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-f2da330e-e04f-4a34-a6fa-fd5db9d65026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:07:08.867334 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 808/1619] 10.222.0.20 () {58 vars in 958 bytes} [Wed Jul 27 19:07:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:07:13.450705 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=6 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:07:18.852572 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=6 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:07:41.748332 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc96df-1ba2-4d67-93e9-7a614e728028 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:07:41.748848 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc96df-1ba2-4d67-93e9-7a614e728028 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:07:41.748947 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc96df-1ba2-4d67-93e9-7a614e728028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:07:41.767602 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-91dc96df-1ba2-4d67-93e9-7a614e728028 None None] MFA Rules not processed for user `a277ddae777442869114c4c5deff7d7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:07:41.768919 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-91dc96df-1ba2-4d67-93e9-7a614e728028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:07:41.776851 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 812/1620] 10.222.0.20 () {58 vars in 967 bytes} [Wed Jul 27 19:07:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 19:07:41.790425 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da330e-e04f-4a34-a6fa-fd5db9d65026 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:07:41.804304 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da330e-e04f-4a34-a6fa-fd5db9d65026 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:07:41.809521 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de791608-d84d-459a-ba97-b94976898aed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a9f1909ab3458c8c131986e303831a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:07:41.810135 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de791608-d84d-459a-ba97-b94976898aed service swift] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:07:41.810415 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de791608-d84d-459a-ba97-b94976898aed service swift] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:07:41.810693 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de791608-d84d-459a-ba97-b94976898aed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:07:41.819000 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de791608-d84d-459a-ba97-b94976898aed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:07:41.820615 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de791608-d84d-459a-ba97-b94976898aed service swift] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:07:41.829904 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 809/1621] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Jul 27 19:07:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 19:07:51.762841 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:07:51.832395 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=6 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:08:04.828359 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098af1a4-e464-42d5-85a1-345c22694846 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:04.828827 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098af1a4-e464-42d5-85a1-345c22694846 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:04.828935 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098af1a4-e464-42d5-85a1-345c22694846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:04.851816 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-098af1a4-e464-42d5-85a1-345c22694846 None None] MFA Rules not processed for user `ad9530d9267547f3a1179602c896b342`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:08:04.853000 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-098af1a4-e464-42d5-85a1-345c22694846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:08:04.860626 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 813/1622] 10.222.0.20 () {58 vars in 958 bytes} [Wed Jul 27 19:08:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:08:06.242286 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de791608-d84d-459a-ba97-b94976898aed service swift] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:06.253764 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de791608-d84d-459a-ba97-b94976898aed service swift] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:06.259112 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e45be43-c632-4bc7-a93a-1261fcdd2574 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b0382b170fb49e785a57bbb329d4b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:06.259820 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45be43-c632-4bc7-a93a-1261fcdd2574 service placement] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:06.260104 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45be43-c632-4bc7-a93a-1261fcdd2574 service placement] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:06.260381 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45be43-c632-4bc7-a93a-1261fcdd2574 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:06.268685 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e45be43-c632-4bc7-a93a-1261fcdd2574 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:08:06.270246 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e45be43-c632-4bc7-a93a-1261fcdd2574 service placement] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:08:06.279997 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 810/1623] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 19:08:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:08:14.848267 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=3 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:08:16.275894 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=6 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:08:23.513333 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098af1a4-e464-42d5-85a1-345c22694846 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:23.523328 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098af1a4-e464-42d5-85a1-345c22694846 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:23.526922 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6076fd-d293-4b08-9115-bd80e0e79b8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703f0431d017405d942539de93a565b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:23.527540 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6076fd-d293-4b08-9115-bd80e0e79b8a service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:23.527850 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6076fd-d293-4b08-9115-bd80e0e79b8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:23.528128 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6076fd-d293-4b08-9115-bd80e0e79b8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:23.538266 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6076fd-d293-4b08-9115-bd80e0e79b8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:08:23.539738 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6076fd-d293-4b08-9115-bd80e0e79b8a service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:08:23.549987 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 814/1624] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 19:08:23 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:08:33.545629 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=6 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:12.665368 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e45be43-c632-4bc7-a93a-1261fcdd2574 service placement] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:12.677242 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e45be43-c632-4bc7-a93a-1261fcdd2574 service placement] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:12.683133 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72f62f-2291-4641-9ef5-7b07768a8065 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17fbef9db7734283aaad4962ee160171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:12.683769 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72f62f-2291-4641-9ef5-7b07768a8065 service nova] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:12.684049 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72f62f-2291-4641-9ef5-7b07768a8065 service nova] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:12.684322 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72f62f-2291-4641-9ef5-7b07768a8065 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:12.691862 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f72f62f-2291-4641-9ef5-7b07768a8065 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:12.693431 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f72f62f-2291-4641-9ef5-7b07768a8065 service nova] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:12.703219 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 811/1625] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 19:10:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:10:12.750669 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6076fd-d293-4b08-9115-bd80e0e79b8a service neutron] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:12.759013 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6076fd-d293-4b08-9115-bd80e0e79b8a service neutron] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:12.763170 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a680aa-9ee1-4c2b-9dac-22f9d8911665 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703f0431d017405d942539de93a565b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:12.763795 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a680aa-9ee1-4c2b-9dac-22f9d8911665 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:12.764077 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a680aa-9ee1-4c2b-9dac-22f9d8911665 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:12.764352 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a680aa-9ee1-4c2b-9dac-22f9d8911665 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:12.774485 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a680aa-9ee1-4c2b-9dac-22f9d8911665 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:12.775929 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a680aa-9ee1-4c2b-9dac-22f9d8911665 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:12.786441 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 815/1626] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 19:10:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:10:18.776377 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72f62f-2291-4641-9ef5-7b07768a8065 service nova] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:18.785440 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72f62f-2291-4641-9ef5-7b07768a8065 service nova] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:18.788932 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01c5181-5e70-4906-80bd-bad1c8bb725a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703f0431d017405d942539de93a565b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:18.789532 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c5181-5e70-4906-80bd-bad1c8bb725a service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:18.789813 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c5181-5e70-4906-80bd-bad1c8bb725a service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:18.790591 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c5181-5e70-4906-80bd-bad1c8bb725a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:18.800375 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01c5181-5e70-4906-80bd-bad1c8bb725a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:18.801775 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01c5181-5e70-4906-80bd-bad1c8bb725a service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:18.812912 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 812/1627] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 19:10:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:10:21.220496 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047318f-4bb1-4e77-be6f-fa939e763a67 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:21.220926 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047318f-4bb1-4e77-be6f-fa939e763a67 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:21.221044 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047318f-4bb1-4e77-be6f-fa939e763a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:21.240180 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-9047318f-4bb1-4e77-be6f-fa939e763a67 None None] MFA Rules not processed for user `a277ddae777442869114c4c5deff7d7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:10:21.241340 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-9047318f-4bb1-4e77-be6f-fa939e763a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:10:21.249089 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 816/1628] 10.222.0.20 () {58 vars in 967 bytes} [Wed Jul 27 19:10:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 19:10:21.292847 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01c5181-5e70-4906-80bd-bad1c8bb725a service neutron] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:21.303762 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01c5181-5e70-4906-80bd-bad1c8bb725a service neutron] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:21.309236 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59f576-c3bc-43dd-9892-84a85e53e759 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a9f1909ab3458c8c131986e303831a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:21.309923 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59f576-c3bc-43dd-9892-84a85e53e759 service swift] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:21.310145 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59f576-c3bc-43dd-9892-84a85e53e759 service swift] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:21.310437 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59f576-c3bc-43dd-9892-84a85e53e759 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:21.319430 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb59f576-c3bc-43dd-9892-84a85e53e759 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:21.321038 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb59f576-c3bc-43dd-9892-84a85e53e759 service swift] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:21.329019 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 813/1629] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Jul 27 19:10:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 19:10:21.795881 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90927fba-68b8-4ce4-b01c-bacdb85798b1 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:21.796172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90927fba-68b8-4ce4-b01c-bacdb85798b1 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:21.796450 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90927fba-68b8-4ce4-b01c-bacdb85798b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:21.815024 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-90927fba-68b8-4ce4-b01c-bacdb85798b1 None None] MFA Rules not processed for user `a277ddae777442869114c4c5deff7d7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:10:21.816363 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-90927fba-68b8-4ce4-b01c-bacdb85798b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:10:21.823990 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 817/1630] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Jul 27 19:10:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:10:21.835623 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59f576-c3bc-43dd-9892-84a85e53e759 service swift] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:21.846050 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59f576-c3bc-43dd-9892-84a85e53e759 service swift] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:21.851365 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ab547-2d3b-41fb-8f8d-e92f9e93d7da service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a9f1909ab3458c8c131986e303831a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:21.852006 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ab547-2d3b-41fb-8f8d-e92f9e93d7da service swift] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:21.852858 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ab547-2d3b-41fb-8f8d-e92f9e93d7da service swift] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:21.853217 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ab547-2d3b-41fb-8f8d-e92f9e93d7da service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:21.861720 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ab547-2d3b-41fb-8f8d-e92f9e93d7da service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:21.863322 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ab547-2d3b-41fb-8f8d-e92f9e93d7da service swift] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:21.872288 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 814/1631] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Jul 27 19:10:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 19:10:29.964928 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d360cd3-cd72-43af-a376-ae1b484f1fc1 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:29.965456 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d360cd3-cd72-43af-a376-ae1b484f1fc1 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:29.965547 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d360cd3-cd72-43af-a376-ae1b484f1fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:29.984670 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-6d360cd3-cd72-43af-a376-ae1b484f1fc1 None None] MFA Rules not processed for user `2b44194e4fa143f3b6e9f891927b90a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:10:29.985859 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-6d360cd3-cd72-43af-a376-ae1b484f1fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:10:29.992663 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 818/1632] 10.222.0.20 () {58 vars in 958 bytes} [Wed Jul 27 19:10:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:10:30.243492 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ab547-2d3b-41fb-8f8d-e92f9e93d7da service swift] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:30.252592 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ab547-2d3b-41fb-8f8d-e92f9e93d7da service swift] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:30.256403 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c199a24d-f750-408e-b70e-83ee3b07142b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703f0431d017405d942539de93a565b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:30.257003 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199a24d-f750-408e-b70e-83ee3b07142b service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:30.257284 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199a24d-f750-408e-b70e-83ee3b07142b service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:30.257558 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199a24d-f750-408e-b70e-83ee3b07142b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:30.264659 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c199a24d-f750-408e-b70e-83ee3b07142b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:30.266071 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c199a24d-f750-408e-b70e-83ee3b07142b service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:30.273714 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 815/1633] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 19:10:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:10:30.588028 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d360cd3-cd72-43af-a376-ae1b484f1fc1 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:30.599579 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d360cd3-cd72-43af-a376-ae1b484f1fc1 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:30.605478 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed0d320-0e6f-4147-9e4e-f8935d38e2f7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b0382b170fb49e785a57bbb329d4b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:30.606095 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0d320-0e6f-4147-9e4e-f8935d38e2f7 service placement] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:30.606380 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0d320-0e6f-4147-9e4e-f8935d38e2f7 service placement] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:30.606654 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0d320-0e6f-4147-9e4e-f8935d38e2f7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:30.615465 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed0d320-0e6f-4147-9e4e-f8935d38e2f7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:30.617256 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed0d320-0e6f-4147-9e4e-f8935d38e2f7 service placement] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:30.627777 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 819/1634] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 19:10:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:10:31.869580 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929fcdcc-01b8-402d-a5a9-b0660698aeda None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:31.870036 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929fcdcc-01b8-402d-a5a9-b0660698aeda None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:31.870314 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929fcdcc-01b8-402d-a5a9-b0660698aeda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:31.889244 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-929fcdcc-01b8-402d-a5a9-b0660698aeda None None] MFA Rules not processed for user `a277ddae777442869114c4c5deff7d7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:10:31.890454 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-929fcdcc-01b8-402d-a5a9-b0660698aeda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:10:31.897657 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 816/1635] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Jul 27 19:10:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:10:31.910574 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed0d320-0e6f-4147-9e4e-f8935d38e2f7 service placement] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:31.922041 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed0d320-0e6f-4147-9e4e-f8935d38e2f7 service placement] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:31.927191 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc70089-b292-4192-8243-215ddaaca876 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a9f1909ab3458c8c131986e303831a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:31.927949 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc70089-b292-4192-8243-215ddaaca876 service swift] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:31.928236 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc70089-b292-4192-8243-215ddaaca876 service swift] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:31.928510 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc70089-b292-4192-8243-215ddaaca876 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:31.936904 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc70089-b292-4192-8243-215ddaaca876 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:31.938465 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc70089-b292-4192-8243-215ddaaca876 service swift] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:31.946721 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 820/1636] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Jul 27 19:10:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 19:10:40.450583 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929fcdcc-01b8-402d-a5a9-b0660698aeda None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:40.457524 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=34 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:40.464843 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929fcdcc-01b8-402d-a5a9-b0660698aeda None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:40.470145 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945f9e8-989f-4656-938e-811cdb173f70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17fbef9db7734283aaad4962ee160171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:40.470748 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945f9e8-989f-4656-938e-811cdb173f70 service nova] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:40.471021 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945f9e8-989f-4656-938e-811cdb173f70 service nova] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:40.471285 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945f9e8-989f-4656-938e-811cdb173f70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:40.480131 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b945f9e8-989f-4656-938e-811cdb173f70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:40.481688 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b945f9e8-989f-4656-938e-811cdb173f70 service nova] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:40.490283 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 817/1637] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 19:10:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 19:10:41.943284 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=27 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:43.042780 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc70089-b292-4192-8243-215ddaaca876 service swift] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:43.045219 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-fbc70089-b292-4192-8243-215ddaaca876 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:10:43.057696 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc70089-b292-4192-8243-215ddaaca876 service swift] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:43.061251 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04de3fa-5333-4b0c-b0b4-51b6efa26c2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703f0431d017405d942539de93a565b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:43.061870 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04de3fa-5333-4b0c-b0b4-51b6efa26c2a service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:43.062136 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04de3fa-5333-4b0c-b0b4-51b6efa26c2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:43.062415 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04de3fa-5333-4b0c-b0b4-51b6efa26c2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:43.069347 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04de3fa-5333-4b0c-b0b4-51b6efa26c2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:43.070763 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04de3fa-5333-4b0c-b0b4-51b6efa26c2a service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:43.078732 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 821/1638] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 19:10:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:10:45.844689 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945f9e8-989f-4656-938e-811cdb173f70 service nova] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:45.856242 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945f9e8-989f-4656-938e-811cdb173f70 service nova] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:45.861846 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ca189-862e-46fe-8a23-428002ad23e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17fbef9db7734283aaad4962ee160171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:45.862450 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ca189-862e-46fe-8a23-428002ad23e8 service nova] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:45.862728 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ca189-862e-46fe-8a23-428002ad23e8 service nova] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:45.862995 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ca189-862e-46fe-8a23-428002ad23e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:45.881459 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291ca189-862e-46fe-8a23-428002ad23e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:45.884030 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291ca189-862e-46fe-8a23-428002ad23e8 service nova] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:45.898748 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 818/1639] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 19:10:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:10:48.873456 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c169c-334f-4e2a-b0e8-377b73a42a40 None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:48.873954 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c169c-334f-4e2a-b0e8-377b73a42a40 None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:48.874039 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c169c-334f-4e2a-b0e8-377b73a42a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:48.892556 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-f51c169c-334f-4e2a-b0e8-377b73a42a40 None None] MFA Rules not processed for user `ad9530d9267547f3a1179602c896b342`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:10:48.893931 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-f51c169c-334f-4e2a-b0e8-377b73a42a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:10:48.901888 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 822/1640] 10.222.0.20 () {58 vars in 958 bytes} [Wed Jul 27 19:10:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:10:51.377584 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ca189-862e-46fe-8a23-428002ad23e8 service nova] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:51.399996 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ca189-862e-46fe-8a23-428002ad23e8 service nova] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:51.409184 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d907959-57ec-49c7-b014-b45b38e6d6b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17fbef9db7734283aaad4962ee160171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:51.409817 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d907959-57ec-49c7-b014-b45b38e6d6b7 service nova] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:51.410278 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d907959-57ec-49c7-b014-b45b38e6d6b7 service nova] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:51.410708 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d907959-57ec-49c7-b014-b45b38e6d6b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:51.430779 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d907959-57ec-49c7-b014-b45b38e6d6b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:51.433069 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d907959-57ec-49c7-b014-b45b38e6d6b7 service nova] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:51.460810 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 819/1641] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 19:10:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:10:58.887519 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=9 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:11:01.442116 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=17 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:11:04.769612 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c169c-334f-4e2a-b0e8-377b73a42a40 None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:11:04.779575 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c169c-334f-4e2a-b0e8-377b73a42a40 None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:11:04.783116 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a53be-e643-4881-9abd-4d9b8d9b8419 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703f0431d017405d942539de93a565b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:11:04.783741 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a53be-e643-4881-9abd-4d9b8d9b8419 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:11:04.784026 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a53be-e643-4881-9abd-4d9b8d9b8419 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:11:04.784302 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a53be-e643-4881-9abd-4d9b8d9b8419 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:11:04.793005 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769a53be-e643-4881-9abd-4d9b8d9b8419 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:11:04.794413 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769a53be-e643-4881-9abd-4d9b8d9b8419 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:11:04.804166 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 823/1642] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 19:11:04 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:11:14.799706 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=6 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:13:23.527779 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f550d-6e90-497d-a3c3-52dafd8b287b None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:13:23.528310 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f550d-6e90-497d-a3c3-52dafd8b287b None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:13:23.528310 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f550d-6e90-497d-a3c3-52dafd8b287b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:13:23.556016 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-c65f550d-6e90-497d-a3c3-52dafd8b287b None None] MFA Rules not processed for user `ad9530d9267547f3a1179602c896b342`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:13:23.557213 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-c65f550d-6e90-497d-a3c3-52dafd8b287b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:13:23.580777 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 820/1643] 10.222.0.20 () {58 vars in 958 bytes} [Wed Jul 27 19:13:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 19:13:23.897778 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a53be-e643-4881-9abd-4d9b8d9b8419 service neutron] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:13:23.899420 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-769a53be-e643-4881-9abd-4d9b8d9b8419 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:13:23.949904 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a53be-e643-4881-9abd-4d9b8d9b8419 service neutron] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:13:23.954127 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf5f3b-7790-42a8-ab3b-932062b3d7ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703f0431d017405d942539de93a565b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:13:23.954728 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf5f3b-7790-42a8-ab3b-932062b3d7ef service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:13:23.955007 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf5f3b-7790-42a8-ab3b-932062b3d7ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:13:23.955282 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf5f3b-7790-42a8-ab3b-932062b3d7ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:13:23.962332 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bf5f3b-7790-42a8-ab3b-932062b3d7ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:13:23.963670 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bf5f3b-7790-42a8-ab3b-932062b3d7ef service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:13:23.971950 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 824/1644] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 19:13:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:13:24.875292 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f550d-6e90-497d-a3c3-52dafd8b287b None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:13:24.903154 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f550d-6e90-497d-a3c3-52dafd8b287b None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:13:24.909041 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ad418-e3e4-4f9e-87c5-c1d077fb9b79 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b0382b170fb49e785a57bbb329d4b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:13:24.909655 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ad418-e3e4-4f9e-87c5-c1d077fb9b79 service placement] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:13:24.909938 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ad418-e3e4-4f9e-87c5-c1d077fb9b79 service placement] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:13:24.910243 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ad418-e3e4-4f9e-87c5-c1d077fb9b79 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:13:24.912145 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-700ad418-e3e4-4f9e-87c5-c1d077fb9b79 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:13:24.935914 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ad418-e3e4-4f9e-87c5-c1d077fb9b79 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:13:24.937516 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ad418-e3e4-4f9e-87c5-c1d077fb9b79 service placement] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:13:24.947029 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 821/1645] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 19:13:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:13:33.808506 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf5f3b-7790-42a8-ab3b-932062b3d7ef service neutron] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:13:33.839568 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf5f3b-7790-42a8-ab3b-932062b3d7ef service neutron] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:13:33.847697 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e966583-1bd2-49b1-8011-c2557d457795 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17fbef9db7734283aaad4962ee160171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:13:33.848490 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e966583-1bd2-49b1-8011-c2557d457795 service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:13:33.849057 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e966583-1bd2-49b1-8011-c2557d457795 service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:13:33.849777 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e966583-1bd2-49b1-8011-c2557d457795 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:13:33.859394 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e966583-1bd2-49b1-8011-c2557d457795 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:13:33.861123 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e966583-1bd2-49b1-8011-c2557d457795 service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:13:33.872630 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 825/1646] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 19:13:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:13:34.943088 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=33 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:13:42.337411 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172087bc-76af-48b0-b223-ad8a280eea03 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:13:42.337994 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172087bc-76af-48b0-b223-ad8a280eea03 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:13:42.338181 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172087bc-76af-48b0-b223-ad8a280eea03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:13:42.369126 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-172087bc-76af-48b0-b223-ad8a280eea03 None None] MFA Rules not processed for user `a277ddae777442869114c4c5deff7d7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:13:42.370349 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-172087bc-76af-48b0-b223-ad8a280eea03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:13:42.377532 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 822/1647] 10.222.0.20 () {58 vars in 967 bytes} [Wed Jul 27 19:13:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:13:42.420449 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e966583-1bd2-49b1-8011-c2557d457795 service nova] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:13:42.431362 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e966583-1bd2-49b1-8011-c2557d457795 service nova] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:13:42.436909 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa1f0f-0f56-40d0-99d6-1083862580fd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a9f1909ab3458c8c131986e303831a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:13:42.437518 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa1f0f-0f56-40d0-99d6-1083862580fd service swift] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:13:42.437801 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa1f0f-0f56-40d0-99d6-1083862580fd service swift] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:13:42.438075 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa1f0f-0f56-40d0-99d6-1083862580fd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:13:42.446292 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa1f0f-0f56-40d0-99d6-1083862580fd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:13:42.447837 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa1f0f-0f56-40d0-99d6-1083862580fd service swift] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:13:42.456266 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 826/1648] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Jul 27 19:13:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 19:13:42.614188 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172087bc-76af-48b0-b223-ad8a280eea03 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:13:42.623803 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172087bc-76af-48b0-b223-ad8a280eea03 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:13:42.627905 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c70ef-ea70-4ab8-aea5-af5d53457933 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703f0431d017405d942539de93a565b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:13:42.628535 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c70ef-ea70-4ab8-aea5-af5d53457933 service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:13:42.628817 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c70ef-ea70-4ab8-aea5-af5d53457933 service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:13:42.629092 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c70ef-ea70-4ab8-aea5-af5d53457933 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:13:42.638619 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c70ef-ea70-4ab8-aea5-af5d53457933 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:13:42.640650 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c70ef-ea70-4ab8-aea5-af5d53457933 service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:13:42.655259 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 823/1649] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 19:13:42 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:13:42.837473 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa1f0f-0f56-40d0-99d6-1083862580fd service swift] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:13:42.847602 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa1f0f-0f56-40d0-99d6-1083862580fd service swift] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:13:42.851522 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fdf2a9-941d-4469-980c-ae2b3e32acc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703f0431d017405d942539de93a565b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:13:42.852160 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fdf2a9-941d-4469-980c-ae2b3e32acc7 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:13:42.852443 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fdf2a9-941d-4469-980c-ae2b3e32acc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:13:42.852720 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fdf2a9-941d-4469-980c-ae2b3e32acc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:13:42.925696 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fdf2a9-941d-4469-980c-ae2b3e32acc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:13:42.927129 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fdf2a9-941d-4469-980c-ae2b3e32acc7 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:13:42.947524 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 827/1650] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 19:13:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:13:46.858620 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51c41d-e24e-4464-90fd-788ccec9b851 None None] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:13:46.859157 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51c41d-e24e-4464-90fd-788ccec9b851 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:13:46.859256 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51c41d-e24e-4464-90fd-788ccec9b851 None None] PATH_INFO: `/` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:13:46.860683 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 824/1651] 10.222.0.20 () {54 vars in 921 bytes} [Wed Jul 27 19:13:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:13:46.869975 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d90f66-0a9e-4a41-a2fa-ab166fbef55e None None] REQUEST_METHOD: `POST` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:13:46.870401 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d90f66-0a9e-4a41-a2fa-ab166fbef55e None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:13:46.870529 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d90f66-0a9e-4a41-a2fa-ab166fbef55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:13:46.875418 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=82 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:13:46.922919 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.auth.core [None req-d3d90f66-0a9e-4a41-a2fa-ab166fbef55e None None] MFA Rules not processed for user `3b0382b170fb49e785a57bbb329d4b37`. Rule list: `[]` (Enabled: `True`). {{(pid=80076) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:13:46.924941 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-d3d90f66-0a9e-4a41-a2fa-ab166fbef55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:13:46.933690 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 828/1652] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Jul 27 19:13:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:13:46.953773 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea51c41d-e24e-4464-90fd-788ccec9b851 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:13:46.967592 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea51c41d-e24e-4464-90fd-788ccec9b851 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:13:46.972471 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666df04d-5915-47c8-b36b-19d073f28fb0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b0382b170fb49e785a57bbb329d4b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:13:46.973066 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666df04d-5915-47c8-b36b-19d073f28fb0 service placement] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:13:46.973340 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666df04d-5915-47c8-b36b-19d073f28fb0 service placement] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:13:46.973606 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666df04d-5915-47c8-b36b-19d073f28fb0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:13:46.982106 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666df04d-5915-47c8-b36b-19d073f28fb0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:13:46.984229 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666df04d-5915-47c8-b36b-19d073f28fb0 service placement] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:13:46.993887 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 825/1653] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 19:13:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:13:50.052178 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d90f66-0a9e-4a41-a2fa-ab166fbef55e None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:13:50.066846 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d90f66-0a9e-4a41-a2fa-ab166fbef55e None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:13:50.071560 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023cffe-f1e6-4e37-b4df-0349df39650e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6643b58dd5014772a6237180b96549c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:13:50.072282 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023cffe-f1e6-4e37-b4df-0349df39650e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:13:50.072556 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023cffe-f1e6-4e37-b4df-0349df39650e admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:13:50.073115 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023cffe-f1e6-4e37-b4df-0349df39650e admin admin] PATH_INFO: `/v3/users/2b44194e4fa143f3b6e9f891927b90a6` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:13:50.075332 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7023cffe-f1e6-4e37-b4df-0349df39650e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b44194e4fa143f3b6e9f891927b90a6)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:13:50.077510 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7023cffe-f1e6-4e37-b4df-0349df39650e admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:13:50.148659 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-7023cffe-f1e6-4e37-b4df-0349df39650e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b44194e4fa143f3b6e9f891927b90a6'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:13:50.149315 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-7023cffe-f1e6-4e37-b4df-0349df39650e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b44194e4fa143f3b6e9f891927b90a6'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:13:50.157629 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-7023cffe-f1e6-4e37-b4df-0349df39650e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b44194e4fa143f3b6e9f891927b90a6'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:13:50.173734 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-7023cffe-f1e6-4e37-b4df-0349df39650e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b44194e4fa143f3b6e9f891927b90a6'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:13:50.180694 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-7023cffe-f1e6-4e37-b4df-0349df39650e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b44194e4fa143f3b6e9f891927b90a6'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:13:50.187330 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 829/1654] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Jul 27 19:13:50 2022] DELETE /identity/v3/users/2b44194e4fa143f3b6e9f891927b90a6 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:13:50.367769 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666df04d-5915-47c8-b36b-19d073f28fb0 service placement] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:13:50.384340 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666df04d-5915-47c8-b36b-19d073f28fb0 service placement] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:13:50.456346 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b6d31-7832-4b86-a992-516c24444233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6643b58dd5014772a6237180b96549c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:13:50.456986 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b6d31-7832-4b86-a992-516c24444233 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:13:50.457267 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b6d31-7832-4b86-a992-516c24444233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:13:50.457546 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b6d31-7832-4b86-a992-516c24444233 admin admin] PATH_INFO: `/v3/projects/18bc32d6d70543c681b79e6bcf8c9ade` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:13:50.458760 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53b6d31-7832-4b86-a992-516c24444233 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18bc32d6d70543c681b79e6bcf8c9ade)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:13:50.460701 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53b6d31-7832-4b86-a992-516c24444233 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:13:50.505757 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-d53b6d31-7832-4b86-a992-516c24444233 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18bc32d6d70543c681b79e6bcf8c9ade', 'request_id': 'req-d53b6d31-7832-4b86-a992-516c24444233'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:13:50.511626 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-d53b6d31-7832-4b86-a992-516c24444233 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18bc32d6d70543c681b79e6bcf8c9ade', 'request_id': 'req-d53b6d31-7832-4b86-a992-516c24444233'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:13:50.519425 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-d53b6d31-7832-4b86-a992-516c24444233 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18bc32d6d70543c681b79e6bcf8c9ade', 'request_id': 'req-d53b6d31-7832-4b86-a992-516c24444233'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:13:50.542400 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-d53b6d31-7832-4b86-a992-516c24444233 admin admin] The token cache is being invalidate because project 18bc32d6d70543c681b79e6bcf8c9ade was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 19:13:50.542712 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-d53b6d31-7832-4b86-a992-516c24444233 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:13:50.543336 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-d53b6d31-7832-4b86-a992-516c24444233 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:13:50.545514 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 826/1655] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Jul 27 19:13:50 2022] DELETE /identity/v3/projects/18bc32d6d70543c681b79e6bcf8c9ade => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:13:50.549511 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023cffe-f1e6-4e37-b4df-0349df39650e admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:13:50.550907 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-7023cffe-f1e6-4e37-b4df-0349df39650e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:13:50.563636 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023cffe-f1e6-4e37-b4df-0349df39650e admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:13:50.618274 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e0223b-3995-49b1-894c-2d2cbe78d130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6643b58dd5014772a6237180b96549c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:13:50.618904 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0223b-3995-49b1-894c-2d2cbe78d130 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:13:50.619185 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0223b-3995-49b1-894c-2d2cbe78d130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:13:50.619457 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0223b-3995-49b1-894c-2d2cbe78d130 admin admin] PATH_INFO: `/v3/users/7a991cdd2f11414fa8661188117712eb` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:13:50.620630 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e0223b-3995-49b1-894c-2d2cbe78d130 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a991cdd2f11414fa8661188117712eb)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:13:50.622514 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e0223b-3995-49b1-894c-2d2cbe78d130 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:13:50.668321 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d2e0223b-3995-49b1-894c-2d2cbe78d130 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a991cdd2f11414fa8661188117712eb'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:13:50.668965 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d2e0223b-3995-49b1-894c-2d2cbe78d130 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a991cdd2f11414fa8661188117712eb'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:13:50.671246 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:13:50.678098 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d2e0223b-3995-49b1-894c-2d2cbe78d130 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a991cdd2f11414fa8661188117712eb'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:13:50.691120 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d2e0223b-3995-49b1-894c-2d2cbe78d130 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a991cdd2f11414fa8661188117712eb'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:13:50.697808 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d2e0223b-3995-49b1-894c-2d2cbe78d130 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a991cdd2f11414fa8661188117712eb'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:13:50.704300 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 830/1656] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Jul 27 19:13:50 2022] DELETE /identity/v3/users/7a991cdd2f11414fa8661188117712eb => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:13:50.872564 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b6d31-7832-4b86-a992-516c24444233 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:13:50.873848 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-d53b6d31-7832-4b86-a992-516c24444233 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:13:50.887043 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b6d31-7832-4b86-a992-516c24444233 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:13:50.920983 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:13:50.944731 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2db0c-8dc4-4634-b405-7935076f2200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6643b58dd5014772a6237180b96549c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:13:50.945359 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2db0c-8dc4-4634-b405-7935076f2200 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:13:50.945634 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2db0c-8dc4-4634-b405-7935076f2200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:13:50.945904 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2db0c-8dc4-4634-b405-7935076f2200 admin admin] PATH_INFO: `/v3/projects/bdf017012c8c4113a3a10cd6764956f9` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:13:50.947035 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a2db0c-8dc4-4634-b405-7935076f2200 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdf017012c8c4113a3a10cd6764956f9)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:13:50.948949 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a2db0c-8dc4-4634-b405-7935076f2200 admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:13:50.994790 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-28a2db0c-8dc4-4634-b405-7935076f2200 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdf017012c8c4113a3a10cd6764956f9', 'request_id': 'req-28a2db0c-8dc4-4634-b405-7935076f2200'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:13:51.000750 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-28a2db0c-8dc4-4634-b405-7935076f2200 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdf017012c8c4113a3a10cd6764956f9', 'request_id': 'req-28a2db0c-8dc4-4634-b405-7935076f2200'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:13:51.007850 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-28a2db0c-8dc4-4634-b405-7935076f2200 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdf017012c8c4113a3a10cd6764956f9', 'request_id': 'req-28a2db0c-8dc4-4634-b405-7935076f2200'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:13:51.018508 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-28a2db0c-8dc4-4634-b405-7935076f2200 admin admin] The token cache is being invalidate because project bdf017012c8c4113a3a10cd6764956f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 19:13:51.018794 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-28a2db0c-8dc4-4634-b405-7935076f2200 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:13:51.019412 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-28a2db0c-8dc4-4634-b405-7935076f2200 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:13:51.021480 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 827/1657] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Jul 27 19:13:50 2022] DELETE /identity/v3/projects/bdf017012c8c4113a3a10cd6764956f9 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:14:00.700256 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=12 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:14:01.015567 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=34,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:15:43.527419 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e0223b-3995-49b1-894c-2d2cbe78d130 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:15:43.529532 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-d2e0223b-3995-49b1-894c-2d2cbe78d130 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:15:43.584060 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e0223b-3995-49b1-894c-2d2cbe78d130 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:15:43.632148 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968af669-6bb3-419d-adac-d2d60c9198ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703f0431d017405d942539de93a565b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:15:43.632784 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968af669-6bb3-419d-adac-d2d60c9198ff service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:43.633098 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968af669-6bb3-419d-adac-d2d60c9198ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:43.633428 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968af669-6bb3-419d-adac-d2d60c9198ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:43.635398 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-968af669-6bb3-419d-adac-d2d60c9198ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:15:43.716719 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968af669-6bb3-419d-adac-d2d60c9198ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:15:43.718138 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968af669-6bb3-419d-adac-d2d60c9198ff service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:15:43.737096 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 831/1658] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 19:15:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:15:44.833172 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2db0c-8dc4-4634-b405-7935076f2200 admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:15:44.834731 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-28a2db0c-8dc4-4634-b405-7935076f2200 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:15:44.849346 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2db0c-8dc4-4634-b405-7935076f2200 admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:15:44.855848 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72740e9f-dacc-4419-9ab9-56c761879417 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703f0431d017405d942539de93a565b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:15:44.856625 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72740e9f-dacc-4419-9ab9-56c761879417 service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:44.857528 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72740e9f-dacc-4419-9ab9-56c761879417 service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:44.858263 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72740e9f-dacc-4419-9ab9-56c761879417 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:44.860180 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-72740e9f-dacc-4419-9ab9-56c761879417 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:15:44.871732 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72740e9f-dacc-4419-9ab9-56c761879417 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:15:44.875157 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72740e9f-dacc-4419-9ab9-56c761879417 service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:15:44.888135 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 828/1659] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 19:15:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:15:44.942338 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968af669-6bb3-419d-adac-d2d60c9198ff service neutron] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:15:44.950778 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968af669-6bb3-419d-adac-d2d60c9198ff service neutron] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:15:44.954644 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f55ead-b5a7-463b-958f-4fa00071bdd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703f0431d017405d942539de93a565b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:15:44.955360 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f55ead-b5a7-463b-958f-4fa00071bdd2 service neutron] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:44.955736 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f55ead-b5a7-463b-958f-4fa00071bdd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:44.956081 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f55ead-b5a7-463b-958f-4fa00071bdd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:44.957901 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-75f55ead-b5a7-463b-958f-4fa00071bdd2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:15:45.003152 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=100 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:15:45.043751 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f55ead-b5a7-463b-958f-4fa00071bdd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:15:45.045728 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f55ead-b5a7-463b-958f-4fa00071bdd2 service neutron] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:15:45.056555 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 832/1660] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 19:15:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:15:46.266598 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72740e9f-dacc-4419-9ab9-56c761879417 service neutron] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:15:46.275212 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72740e9f-dacc-4419-9ab9-56c761879417 service neutron] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:15:46.278805 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572491cd-9ae2-425e-a54c-3834a1b7c492 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703f0431d017405d942539de93a565b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:15:46.279412 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572491cd-9ae2-425e-a54c-3834a1b7c492 service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:46.279739 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572491cd-9ae2-425e-a54c-3834a1b7c492 service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:46.279992 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572491cd-9ae2-425e-a54c-3834a1b7c492 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:46.281713 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-572491cd-9ae2-425e-a54c-3834a1b7c492 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:15:46.295026 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572491cd-9ae2-425e-a54c-3834a1b7c492 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:15:46.296460 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572491cd-9ae2-425e-a54c-3834a1b7c492 service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:15:46.306915 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 829/1661] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 19:15:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:15:53.926450 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f55ead-b5a7-463b-958f-4fa00071bdd2 service neutron] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:15:53.928420 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-75f55ead-b5a7-463b-958f-4fa00071bdd2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:15:53.942247 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f55ead-b5a7-463b-958f-4fa00071bdd2 service neutron] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:15:53.948067 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c4887-8108-4f0c-a043-38fdd696c7dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17fbef9db7734283aaad4962ee160171', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:15:53.948720 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c4887-8108-4f0c-a043-38fdd696c7dc service nova] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:53.949056 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c4887-8108-4f0c-a043-38fdd696c7dc service nova] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:53.949339 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c4887-8108-4f0c-a043-38fdd696c7dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:53.951639 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-189c4887-8108-4f0c-a043-38fdd696c7dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:15:53.967123 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189c4887-8108-4f0c-a043-38fdd696c7dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:15:53.968725 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189c4887-8108-4f0c-a043-38fdd696c7dc service nova] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:15:53.979508 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 833/1662] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 19:15:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:15:56.302418 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=12 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:15:56.985224 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572491cd-9ae2-425e-a54c-3834a1b7c492 service neutron] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:15:56.986668 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-572491cd-9ae2-425e-a54c-3834a1b7c492 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:15:56.997840 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572491cd-9ae2-425e-a54c-3834a1b7c492 service neutron] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:15:57.001683 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ecd9a5-4e90-42a4-bab0-6808ece1f2d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703f0431d017405d942539de93a565b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:15:57.002339 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ecd9a5-4e90-42a4-bab0-6808ece1f2d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:15:57.002690 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ecd9a5-4e90-42a4-bab0-6808ece1f2d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:15:57.002990 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ecd9a5-4e90-42a4-bab0-6808ece1f2d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:15:57.004795 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-25ecd9a5-4e90-42a4-bab0-6808ece1f2d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:15:57.069850 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ecd9a5-4e90-42a4-bab0-6808ece1f2d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:15:57.071394 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ecd9a5-4e90-42a4-bab0-6808ece1f2d0 service neutron] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:15:57.081696 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 830/1663] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 19:15:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:16:03.052041 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9454249-badc-4d19-96f9-34c7314e8cfd None None] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:16:03.052550 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9454249-badc-4d19-96f9-34c7314e8cfd None None] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:16:03.052641 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9454249-badc-4d19-96f9-34c7314e8cfd None None] PATH_INFO: `/` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:16:03.054064 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 834/1664] 10.222.0.20 () {54 vars in 921 bytes} [Wed Jul 27 19:16:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 19:16:03.081550 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264bd29-838e-4c63-beeb-bfc519389337 None None] REQUEST_METHOD: `POST` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:16:03.082030 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264bd29-838e-4c63-beeb-bfc519389337 None None] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:16:03.082140 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264bd29-838e-4c63-beeb-bfc519389337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:16:03.104644 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.auth.core [None req-f264bd29-838e-4c63-beeb-bfc519389337 None None] MFA Rules not processed for user `3b0382b170fb49e785a57bbb329d4b37`. Rule list: `[]` (Enabled: `True`). {{(pid=80075) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:16:03.107788 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-f264bd29-838e-4c63-beeb-bfc519389337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:16:03.130455 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9454249-badc-4d19-96f9-34c7314e8cfd None None] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:16:03.132282 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-a9454249-badc-4d19-96f9-34c7314e8cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:16:03.148706 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9454249-badc-4d19-96f9-34c7314e8cfd None None] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:16:03.154250 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d15f3d-df4a-4c02-a7cd-aa94edee4551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6643b58dd5014772a6237180b96549c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:16:03.154980 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d15f3d-df4a-4c02-a7cd-aa94edee4551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:16:03.155332 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d15f3d-df4a-4c02-a7cd-aa94edee4551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:16:03.155828 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d15f3d-df4a-4c02-a7cd-aa94edee4551 admin admin] PATH_INFO: `/v3/users/ad9530d9267547f3a1179602c896b342` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:16:03.157075 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d15f3d-df4a-4c02-a7cd-aa94edee4551 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad9530d9267547f3a1179602c896b342)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:16:03.159150 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d15f3d-df4a-4c02-a7cd-aa94edee4551 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:16:03.177970 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 831/1665] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Jul 27 19:16:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:16:03.190519 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f264bd29-838e-4c63-beeb-bfc519389337 None None] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:16:03.191972 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-f264bd29-838e-4c63-beeb-bfc519389337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:16:03.205401 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f264bd29-838e-4c63-beeb-bfc519389337 None None] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:16:03.208569 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-c9d15f3d-df4a-4c02-a7cd-aa94edee4551 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad9530d9267547f3a1179602c896b342'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:16:03.209208 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-c9d15f3d-df4a-4c02-a7cd-aa94edee4551 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad9530d9267547f3a1179602c896b342'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:16:03.210825 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2131bb1d-7fb3-409d-8565-50145b2f40e8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b0382b170fb49e785a57bbb329d4b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:16:03.211442 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131bb1d-7fb3-409d-8565-50145b2f40e8 service placement] REQUEST_METHOD: `GET` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:16:03.211750 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131bb1d-7fb3-409d-8565-50145b2f40e8 service placement] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:16:03.212027 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131bb1d-7fb3-409d-8565-50145b2f40e8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:16:03.216846 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-c9d15f3d-df4a-4c02-a7cd-aa94edee4551 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad9530d9267547f3a1179602c896b342'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:16:03.221342 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2131bb1d-7fb3-409d-8565-50145b2f40e8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:16:03.223046 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2131bb1d-7fb3-409d-8565-50145b2f40e8 service placement] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:16:03.229397 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-c9d15f3d-df4a-4c02-a7cd-aa94edee4551 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad9530d9267547f3a1179602c896b342'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:16:03.232878 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 832/1666] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 19:16:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 19:16:03.236087 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-c9d15f3d-df4a-4c02-a7cd-aa94edee4551 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad9530d9267547f3a1179602c896b342'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:16:03.242077 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 835/1667] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Jul 27 19:16:03 2022] DELETE /identity/v3/users/ad9530d9267547f3a1179602c896b342 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 19:16:03.415646 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2131bb1d-7fb3-409d-8565-50145b2f40e8 service placement] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:16:03.427373 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2131bb1d-7fb3-409d-8565-50145b2f40e8 service placement] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:16:03.486952 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d14c3d-a211-4048-aea4-3418a825a20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6643b58dd5014772a6237180b96549c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:16:03.487585 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d14c3d-a211-4048-aea4-3418a825a20e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:16:03.487904 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d14c3d-a211-4048-aea4-3418a825a20e admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:16:03.488178 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d14c3d-a211-4048-aea4-3418a825a20e admin admin] PATH_INFO: `/v3/projects/3fac488ddb0649beb4af3e9fb463747d` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:16:03.489317 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d14c3d-a211-4048-aea4-3418a825a20e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fac488ddb0649beb4af3e9fb463747d)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:16:03.491291 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d14c3d-a211-4048-aea4-3418a825a20e admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:16:03.512295 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=100 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:16:03.537718 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-45d14c3d-a211-4048-aea4-3418a825a20e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fac488ddb0649beb4af3e9fb463747d', 'request_id': 'req-45d14c3d-a211-4048-aea4-3418a825a20e'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:16:03.543776 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-45d14c3d-a211-4048-aea4-3418a825a20e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fac488ddb0649beb4af3e9fb463747d', 'request_id': 'req-45d14c3d-a211-4048-aea4-3418a825a20e'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:16:03.551278 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-45d14c3d-a211-4048-aea4-3418a825a20e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fac488ddb0649beb4af3e9fb463747d', 'request_id': 'req-45d14c3d-a211-4048-aea4-3418a825a20e'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:16:03.561964 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-45d14c3d-a211-4048-aea4-3418a825a20e admin admin] The token cache is being invalidate because project 3fac488ddb0649beb4af3e9fb463747d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 19:16:03.562281 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-45d14c3d-a211-4048-aea4-3418a825a20e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:16:03.562899 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-45d14c3d-a211-4048-aea4-3418a825a20e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:16:03.564453 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 833/1668] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Jul 27 19:16:03 2022] DELETE /identity/v3/projects/3fac488ddb0649beb4af3e9fb463747d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:16:03.568474 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d15f3d-df4a-4c02-a7cd-aa94edee4551 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:16:03.569855 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-c9d15f3d-df4a-4c02-a7cd-aa94edee4551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:16:03.583296 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d15f3d-df4a-4c02-a7cd-aa94edee4551 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:16:03.638180 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de32e3-8254-40d6-bd7e-3681d829f6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6643b58dd5014772a6237180b96549c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:16:03.638809 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de32e3-8254-40d6-bd7e-3681d829f6b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:16:03.639090 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de32e3-8254-40d6-bd7e-3681d829f6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:16:03.639366 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de32e3-8254-40d6-bd7e-3681d829f6b3 admin admin] PATH_INFO: `/v3/users/1e3f6e084af64d72b0538dcd244974ac` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:16:03.652018 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9de32e3-8254-40d6-bd7e-3681d829f6b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e3f6e084af64d72b0538dcd244974ac)` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:16:03.653986 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9de32e3-8254-40d6-bd7e-3681d829f6b3 admin admin] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:16:03.658279 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:16:03.709209 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d9de32e3-8254-40d6-bd7e-3681d829f6b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e3f6e084af64d72b0538dcd244974ac'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:16:03.709951 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d9de32e3-8254-40d6-bd7e-3681d829f6b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e3f6e084af64d72b0538dcd244974ac'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:16:03.718367 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d9de32e3-8254-40d6-bd7e-3681d829f6b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e3f6e084af64d72b0538dcd244974ac'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:16:03.730267 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d9de32e3-8254-40d6-bd7e-3681d829f6b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e3f6e084af64d72b0538dcd244974ac'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:16:03.737433 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.notifications [None req-d9de32e3-8254-40d6-bd7e-3681d829f6b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e3f6e084af64d72b0538dcd244974ac'} {{(pid=80076) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:16:03.743292 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 836/1669] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Jul 27 19:16:03 2022] DELETE /identity/v3/users/1e3f6e084af64d72b0538dcd244974ac => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:16:03.916951 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d14c3d-a211-4048-aea4-3418a825a20e admin admin] Authenticating user token {{(pid=80075) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:16:03.918424 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.fernet_utils [None req-45d14c3d-a211-4048-aea4-3418a825a20e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80075) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:16:03.932083 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d14c3d-a211-4048-aea4-3418a825a20e admin admin] Validating token access rules against request {{(pid=80075) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:16:04.002624 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ba822-d1c6-4741-baca-a570c277739c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75f20e26df34773ae258f20480b0b50', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6643b58dd5014772a6237180b96549c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80075) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:16:04.003678 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ba822-d1c6-4741-baca-a570c277739c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:16:04.003994 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ba822-d1c6-4741-baca-a570c277739c admin admin] SCRIPT_NAME: `/identity` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:16:04.004272 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ba822-d1c6-4741-baca-a570c277739c admin admin] PATH_INFO: `/v3/projects/17544c3a14e744519a381843f30d204e` {{(pid=80075) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:16:04.016809 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ba822-d1c6-4741-baca-a570c277739c admin admin] RBAC: Authorizing `identity:delete_project(project_id=17544c3a14e744519a381843f30d204e)` {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:16:04.018730 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ba822-d1c6-4741-baca-a570c277739c admin admin] RBAC: Authorization granted {{(pid=80075) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:16:04.075060 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-cf2ba822-d1c6-4741-baca-a570c277739c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17544c3a14e744519a381843f30d204e', 'request_id': 'req-cf2ba822-d1c6-4741-baca-a570c277739c'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:16:04.082197 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-cf2ba822-d1c6-4741-baca-a570c277739c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17544c3a14e744519a381843f30d204e', 'request_id': 'req-cf2ba822-d1c6-4741-baca-a570c277739c'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:16:04.090128 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-cf2ba822-d1c6-4741-baca-a570c277739c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17544c3a14e744519a381843f30d204e', 'request_id': 'req-cf2ba822-d1c6-4741-baca-a570c277739c'} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:16:04.101722 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-cf2ba822-d1c6-4741-baca-a570c277739c admin admin] The token cache is being invalidate because project 17544c3a14e744519a381843f30d204e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80075) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 19:16:04.102014 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-cf2ba822-d1c6-4741-baca-a570c277739c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:16:04.102642 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG keystone.notifications [None req-cf2ba822-d1c6-4741-baca-a570c277739c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80075) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:16:04.104457 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: [pid: 80075|app: 0|req: 834/1670] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Jul 27 19:16:03 2022] DELETE /identity/v3/projects/17544c3a14e744519a381843f30d204e => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 19:16:13.739870 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=24,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:16:14.098640 dv-osbrick-849020-4-iscsi devstack@keystone.service[80075]: DEBUG dbcounter [-] [80075] Writing DB stats keystone:SELECT=71,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80075) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:19:10.165483 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de32e3-8254-40d6-bd7e-3681d829f6b3 admin admin] Authenticating user token {{(pid=80076) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:19:10.166954 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-d9de32e3-8254-40d6-bd7e-3681d829f6b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:19:10.237660 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de32e3-8254-40d6-bd7e-3681d829f6b3 admin admin] Validating token access rules against request {{(pid=80076) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:19:10.295204 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438c728-d406-4f66-83b7-6d9bac1bc86b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b0382b170fb49e785a57bbb329d4b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31f027c53398443eb548eaf3f24523e0', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80076) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:19:10.295845 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438c728-d406-4f66-83b7-6d9bac1bc86b service placement] REQUEST_METHOD: `GET` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:19:10.296130 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438c728-d406-4f66-83b7-6d9bac1bc86b service placement] SCRIPT_NAME: `/identity` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:19:10.296402 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438c728-d406-4f66-83b7-6d9bac1bc86b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80076) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:19:10.298168 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.fernet_utils [None req-b438c728-d406-4f66-83b7-6d9bac1bc86b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80076) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:19:10.309286 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b438c728-d406-4f66-83b7-6d9bac1bc86b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:19:10.310835 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b438c728-d406-4f66-83b7-6d9bac1bc86b service placement] RBAC: Authorization granted {{(pid=80076) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:19:10.321000 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: [pid: 80076|app: 0|req: 837/1671] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 27 19:19:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:19:20.316417 dv-osbrick-849020-4-iscsi devstack@keystone.service[80076]: DEBUG dbcounter [-] [80076] Writing DB stats keystone:SELECT=58 {{(pid=80076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}